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SECTION 1 
INTRODUCTION 


This report presents the results of Task 5 for contract NAS 1-1 8004, sponsored by the 
NASA Langley Research Center. The purpose of this work has been to develop and demonstrate 
methods of design and analysis of control-element failure detection and isolation (FDI) algorithms 
for restructurable flight control systems. This work was coupled with contract NAS 1-1741 1 in 
which control restructuring methods were developed. Several reports document these efforts 
([l]-[3]*). Reference [1] details automatic control design procedures for the restructurable control 
problem and reference [2] details the FDI methods that play a key role in enabling the effective- 
ness of the control redesign procedures. Reference [3] documents a preliminary integration of the 
control redesign and FDI concepts into Fortran-77 subroutine that were then used as the flight 
control module in NASA's B-737 simulation. These efforts all dealt with operation of the aircraft 
at a single flight condition. Promising results at a single flight condition lead to the effort reported 
herein, in which expanded envelopes of operation are considered. 

The purpose of this effort was to develop and demonstrate concepts for expanding the 
envelope of the FDI algorithms that detect and isolate "aircraft-path" failures. An "aircraft path" 
failure is defined as a control element failure based on the analytic redundancy contained in the 
models and measurements associated with force and moment relationships. These failures are the 
most difficult to detect and isolate since analytical relationships between dissimilar sensors 
("analytic-redundancy") must be used. In particular, aerodynamic force and moment balance 
equations that relate measurements of control deflection, angular rates, and relative wind velocities 
to translational and rotational accelerations are used to compare actual aircraft motion with expected 
motion and to detect and identify peculiarities of any discrepancy. Because aircraft-path FDI must 

* References are indicated by numbers in square brackets; the list appears at the end of the main body of this 
report 
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rely on force and moment balance models, there is a natural tradeoff between the accuracy of these 
models and the ability to detect and isolate failures. For single flight condition operation, we 
developed design and analysis methods to deal with this "robustness" problem. When the 
departure from the single flight condition is significant, however, it is not possible to obtain ade- 
quate performance (i.e., both low false alarm and missed detection probabilities) without some 
form of adaptation. This report deals with those adaptations. 

While previous work was applied to models of the B-737 aircraft, this work was applied to 
a high performance fighter aircraft model (the AFTI/F-16) since such aircraft are likely to have 
more stringent restructurable control requirements [1]. The basic methods, however, are valid for 
transport as well as fighter aircraft 

1.1 SUMMARY 

All FDI methods can be decomposed into two major elements; residual generation and 
decision-making. In [2], we explicitly considered the design of each of these elements separately 
in order to better understand and compensate for the effects of many non-idealized factors. This 
effort deals with adaptation mechanisms for expanded envelope operation in the same way. 

For residual generation, adaptation requirements are interpreted as the need for accurate, 
large-motion models, over a broad range of velocity and altitude conditions (in-flight model identi- 
fication was initially considered as a method of residual adaptation but was rejected for several rea- 
sons; see Section 2). For decision-making, adaptation may require modifications to the filtering 
operations, thresholds, and projection vectors that define the various hypothesis tests performed in 
the decision mechanism. 

Methods of obtaining and evaluating residual generation and decisionmaking designs in an 
expanded envelope context have been developed for this project. In addition, we have demon- 
strated the application of the residual generation ideas to a high-performance fighter by developing 
"adaptive" and single flight condition residuals for the AFTI/F-16 and simulating their behavior 
under a variety of maneuvers using the results of NASA's F-16 simulation. 
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SECTION 2 


DESIGN METHODS FOR EXPANDED ENVELOPE OPERATION 
RESIDUAL GENERATION 

In the next two sections we discuss several issues that must be addressed in expanding 
the envelope of operation of the FDI algorithm developed in [2]. Although we consider this 
algorithm explicitly, many of these issues apply to any FDI algorithm. Residual generation and 
decision mechanism issues are addressed separately (residual generation in this section and 
decisionmaking in Section 3), although, as often stated, the performance capabilities of one 
affects the performance requirements of the other. For both FDI processes we discuss when 
the need for envelope-expanding adaptation arises and determine the factors that might affect 
this need. We then present various methods that can be used in the design of adaptation 
mechanisms. 

2.1 DESIGN ISSUES 

The generation of good residuals for use in any decision making process requires, 
ultimately, high fidelity models of the aircraft. Although the concept of "adaptation" is 
sometimes taken to mean on-line "learning" (of the aircraft models for example), for our 
purposes the term adaptation refers to a model "scheduling" concept. The primary reason for 
this view is the inherent problems associated with learning types of adaptation within an FDI 
context; the problem being the adaptation (of aircraft models in our case) to the effects (of the 
failure) that need to be detected. While such adaptation could ultimately provide the 
information required for reconfiguration (e.g., new aircraft models), it obscures the detection 
problem, which must make high fidelity decisions in very short amounts of time (an order of 
magnitude faster than what is usually required for accurate model adaptation [4]). 
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The attainment of truly high fidelity aircraft models over a wide range of operating 
conditions (various dynamic pressure and maneuver conditions) is a difficult problem and, in 
principle, could involve excessive physical modeling of static and dynamic aerodynamic 
behavior as well as validation with wind tunnel and flight test results. Even with such an 
excessive effort, variations amongst aircraft of the same type and variations of a single aircraft 
over time are typically ignored. However, the accuracy requirements for the control element 
EDI problem are such that simple models based on static aircraft characteristics will be 
sufficient for nearly all flight conditions and where they are not (e.g., during transient/dynamic 
airflow conditions ) adequate compensation of the decision making process can be made. 

The keys to the development of adequate aircraft models over a wide range of operating 
conditions are as follows; 

1 . Good physical understanding of aerodynamic effects, and 

2. A means of assessing the quality of any proposed model. 

The need for physical intuition comes about because of the size and number of effects 
that must be modeled. For example, a single residual may be a function of 5 to 10 
(measurable) variables. To model the relationship between the variables (e.g., with a power 
series) without some knowledge of how these variables interact and what types of 
nonlinearities are possible would require an unrealistic number of terms (many of which may 
end up being insignificant) and a possible over-fitting of the model, [5]. Thus, physical 
intuition allows proper model forms to be chosen more easily. For this project, adequate time 
was not available for a full investigation of nonlinear and full-envelope modeling issues. 
Therefore, our approach was to examine and compare a variety of nonlinear aerodynamic 
models and deduce as much as possible about the possible nonlinearities and interactions 
amongst variables. 

Once a model is (or models are) chosen, evaluation in terms that relate directly to the 
residual generation process is necessary. This is at least as important if not more important, 
than developing a good model since accurate characterization of uncertainty leads to accurate 
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performance prediction. As discussed in [2], performance of FDI algorithms depends , in part, 
on the power spectral density of the residuals. This PSD is used to design and evaluate the 
decision mechanism in terms of detectable and isolatable failure magnitudes. Thus, the ultimate 
measure of model quality is the performance of the decision mechanism that uses the 
corresponding model for residual generation. While this is the ultimate measure, its 
computation could be quite involved; including, as it does, a complete decisionmaking design. 
Therefore, simpler measures are sought For this project, we will assume that the filtering 
requirements for each statistical test in the decision mechanism are the same, and can be 
determined (roughly) before residual generation models are formed. Furthermore, we will 
again assume that two types of errors arise, low-frequency "in-band" errors that are unaffected 
by filtering, and sensor noise, whose effect is reduced by filtering. As a result, the use of a 
predicted value for the variance of each residual after filtering is proposed as a measure of 
model quality. 

The three primary issues that must be considered in building an aircraft model for 
residual generation are: 

1. Model fidelity, 

2. Model simplicity, and 

3 . The ability to predict model accuracy in terms of actual aircraft performance. 

Most aircraft development programs go through several phases of modeling in which 

higher-fidelity models are built. While it is tempting to use the latest (and presumably best) 
models for residual generation, the final model that comes out of a full-scale flight test tends to 
be very complex (including table look-up functions and flight-test correction factors). For 
residual generation, the simplification of such a model is required for real time operation. Of 
course, with simplification comes errors. Thus, in characterizing the quality of the models 
inaccuracies between the best model and its simplification, as well as inaccuracies between the 
best model and the real aircraft, should be taken into account The former characterization 
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occurs naturally in the model simplification process. The latter issue is more difficult and 
needs to be addressed in future work. 

The simplification of a high fidelity aerodynamic aircraft model for residual generation 
puiposes is essentially the same as any model simplification or data-analysis procedure. The 
six steps in this process are: 

1 . Determination of potential nonlinearities and interactions from knowledge of 
aerodynamic concepts, 

2. Generation of aerodynamic coefficient values as a function of important 
"independent" (and measurable) variables, 

3 . Plotting of this data to examine anticipated nonlinearities and interactions, 

4. Proposal of a series of analytic model forms for use in residual generation, 

5 . Fitting of each model to the data using a regression analysis, and 

6. Selection of the best model according to a prediction of the variance of the filtered 
residual. 

Steps 4-6 can be accomplished in a variety of ways (e.g., "all-subset regression", 
"backward elimination", and "stepwise regression"; see [5]). In all of these methods, it is 
assumed that the dependent variable (the aerodynamic coefficient) is a sum of terms involving 
the independent variables. The possible terms must be spelled out ahead of time and is the 
most difficult part of any of these methods. This is where steps 1 and 3 (especially plotting 
the data) are needed. For example, potential nonlinear effects that would be expected [e.g., see 
[6]) include: 

1 . Lift-Curve slope for wings varying as - . 

V fl-M 2 ) 

2. Increases in a (below a cr it ) can increase the roll, yaw, and sideslip effectiveness 
on lateral coefficients. 

3 . Reductions in control effectiveness can be expected at high local angles of attack. 

4. Effectiveness of trailing edge surfaces are proportional to local angles of attack. 

5 . Drag is affected by lift (i.e., drag polars). 

6. Small effects of sideslip on lift can be expected. 
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7. Various control nonlinearities are likely. 

8 . Trailing edge wing surfaces are likely to interact with the effects of horizontal tail 
surfaces. 

9. Pitch effectiveness can be proportional to higher powers of lift (e.g., CL2, CL^). 

10. Angle-of-attack rate can affect longitudinal coefficients. 

1 1. The effectiveness of trailing-edge surfaces are proportional to j== . 

V(l-M 2 ) 

Various specific effects for individual models can also be derived. For example, for the 
rolling moment model, we would expect an iteration between a and p since the effect of P on 
roll is dependent on wing and horizontal-tail lift, which is in turn dependent on a. The 
magnitude of the interaction depends on the amount of wing sweep and dihedral/anhedral of the 
wings and horizontal tail. The lift on the wings and horizontal-tail are also influenced by 
deflection of the flaperons, thereby giving rise to a possible interaction between P and flaperon 
deflection. Nonlinearities in P might be expected at high sideslip angles as a result of the 
transition from laminar to turbulent flow over the fuselage. Finally, interactions between P and 
canard deflection might be expected since the snowplow configuration presents an 
asymmetrical profile to side wind components and the location of the canards is such that 
rolling moments may result. 

2.2 DESIGN METHODS 

As discussed above, the development of high-fidelity, full-envelope, aero-models 
requires that all important nonlinearities be modeled. We have divided these nonlinear effects 
into two categories; 1) large-amplitude effects, and 2) flight-condition effects. The large- 
amplitude effects are due to large perturbational changes in aircraft velocities (magnitude and 
direction of translational and rotational velocities) at a single flight-condition (Mach, altitude). 
Large-amplitude effects require nonlinear models mainly because of the changes in lift 
distributions on the various components (wings, body, horizontal tail, etc.) of the aircraft (they 
do not all change equally). Changing flight-conditions cause changes in the "scaling" of the 
nondimensional coefficients (linearly with dynamic pressure; hence a nonlinear multiplicative 
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model) as well as changes in the nondimensional coefficients themselves. The latter effect is 
due to changing lift characteristics as described in [1] and due to changes in the geometry of the 
aircraft due to static flex characteristics. For this project, we will concentrate on developing 
analytical models for large-amplitude effects. Expansion of the envelope to incorporate a wider 
range of flight-conditions will take the form of a scheduling of the "parameters" of several 
single flight-condition models. 

As discussed previously, the first step in developing models for residual generation is 
to determine the form of the models from basic aerodynamic principles. Towards this end, two 
forms have been developed. The first form is based on a simple generalization of the so-called 
"panel" or "component build-up" method. It involves a simple model for the lift and drag due 
to each component (wings, body, horizontal tail, etc.) of the aircraft as a function of the local 
relative wind vector, the panel's "configuration" (e.g., changing camber due to flaps), and 
possible changes in the relative wind vector due to interference effects. The second form is a 
generalization of the linear models commonly used in flight control design and is therefore 
called a quasi-linear method. In this modelling method, the nondimensional "derivatives" are 
functions of variables that would be expected to cause them to change for physical reasons. 
Both methods are discussed below. 

2.2.1 Panel Method Models 

The basic idea of the panel method is that each panel or component of the aircraft 
generates a lift and drag vector whose magnitude and direction are largely determined by the 
magnitude and direction of the local relative wind. This is a common method of aircraft 
modelling [1], [2] and we use it here to provide a simple model form whose specific 
parameters can be identified from an aero-package. 

Let Li and D{ represent the (dimensional) lift and drag force vectors (expressed in a 
body-referenced coordinate system) on the i-th panel of the aircraft. We assume [6] that each 
vector is applied to the aircraft at some average location, q, that the drag vector is applied 
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parallel to the relative wind vector, Vj, and the lift vector is orthogonal to Vj and a unit span 
vector, ejb, for the i-th panel. From these assumptions it is easy to see that each panel 
generates a portion of the total force and moment on the aircraft (at the center of gravity). The 
total body-referenced force on the aircraft is 


F = £L>+Di 

i 


( 2 - 1 ) 


The total moment on the aircraft is 


M=S rj x Lj + r j xD, 
i 


(2-2) 


The magnitude of lift on each panel is modeled as a function of Vi, an interference variable G[ 
(e.g., downwash angle for the horizontal tail), and any configuration variables (e.g., flap 
deflection for the wings, rudder deflection for the vertical tail panel). For a wide range of local 
angles of attack, each panel can be adequately modeled by [6] 

I I-i I = 1/2 p (Ui)2 ( LjO + K a i(Wi/Ui - c { ) + Ktfbi ), (2-3) 

where Ui is the local forward velocity (i.e., the projection of Vi onto a unit chord-vector, ei c , 
for the i-th panel), Wi is the local downward velocity (i.e., the projection of Vi onto a unit 
vector that is orthogonal to ej c and ejb ), is the basic panel lift coefficient for the desired 
flight condition, Wj/Uj is an approximation to the local angle of attack, p is the atmospheric 
density, and 5j is a "configuration" variable (such as trailing/leading edge wing flaps). The 
interference variable, <7i , can also be a function of other parameters and is the least understood 
part of the panel model. Also, note that for some panels (e.g., canards) the projections of Vj 
onto span- and chord- referenced directions will change (e.g., as a function of canard 
deflection) since these vectors can be changed. 

The magnitude of the drag due to each panel is then assumed to be computed from the 
drag-polar relationship [6] 
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IDil = Di ° + K DL 1 14 ft 


(2-4) 


The local relative wind vector, is computed from [7] 

v i = v rw + Cl)xr i, (2-5) 

where V^, is the overall or average relative wind vector on the aircraft, and 0 ) is the body- 
referenced angular velocity vector. 

These equations reduce the modeling problem to one of identifying a few basic 
quantities: q, Lj°, K a i, K 5 I , ef c , and qb . Knowledge of the form of these equations 
should also allow large reductions in the amount of data needed to identify the desired 
quantities. For example, the values of Lj°, K^, K 5 I can be determined solely from force 
relationships at co = 0. Unfortunately, there are some drawbacks to this approach. First, the 
resulting model is not particularly efficient computationally. Many "small" effects that perhaps 
could be ignored are modeled through these relationships. It is also possible that the addition 
of "small" effects can cause deterioration of the quality of the resulting residuals, due to the 
addition of sensor noise. These situations are particularly difficult to identify with this model. 
Also, while the assumption about the directions of lift and drag on each panel are fairly 
standard, it is not clear how accurate this assumption will be in terms of the residual generation 
problem. Finally, the model ignores some potentially important effects such as the movement 
of the center of pressure (essentially q) at a single flight condition. For these reasons, this 
method is not considered further. 

2.2.2 Quasi-Linear Models 

This method of modeling is also common in flight control applications. The basic idea 
is to assume a model for the non-dimensional coefficients of the form, 

c C = S c ^'V (2-6) 

i 
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where £ = x, y, z, 1, m, or n, the y 1 are the measurable quantities that are likely to affect C| 
and the QW are modeled as functions of the yi likely to affect them (still at a single flight 
condition). We use physical knowledge about aerodynamics to postulate the important terms in 
the above equation as well as the quantities that are likely to affect the "derivatives", C^yi. For 
example, for the F- 16 we have developed the roll-coefficient model 

Cl = 

Q_r( a ) r + 

C Lp ( a ) p + 

Ci_p( a, dfc, dsp, p ) p + 

Ci_df a ( ot, dfc, dfa ) dfa + 

Cl_dhta( a ’ dfc, dfa ) dhta + 

Ci_dr( a, dfc, dr ) dr + 

C l_dvc( a > dvc ) dvc » (2-7) 

where 

a = aircraft angle of attack, 

P = aircraft sideslip angle, 

dfc = collective flaperon deflection, 

dfa = asymmetric (differential) flaperon deflection, 

dhta = asymmetric horizontal tail deflection, 

dvc = parallel/vertical canard deflection, 

dsp = snowplow/horizontal canard deflection, 

dr = rudder deflection. 

The terms in the roll-coefficient expansion are the same as those that appear in a linear model. 
The variation of the derivatives with other variables takes into account various physical effects. 
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For example, Q p varies with a because Q_p is partly due to wing sweep. The effect of 
wing sweep, however, increases as the wing lift increases [6], which increases with a. Note 
that the anhedral of the vertical tail and canards also contribute to Q_p with opposite sign (to 
the sweep effect). This effect also increases with lift and hence a. The overall relationship 
between Q p and a is indeterminate since the relative contributions of these physical 
phenomena are unknown. However, it is clear that Q p could be a function of a and hence 
we should attempt to characterize it for residual generation. Similarly, Q_p is a function of 
(dfc) because of its effect on the lift of the wing, thereby affecting the wing sweep effect. The 
dependence on (dsp) is due to the asymmetric profile to side wind components presented by the 
(dsp) configuration and the location of the canards below the x body axis; and the dependence 
on (3 indicates that we expect decreases in Q p at large sideslip angles due to separation (i.e., 
departure from laminar flow). 

The advantage of the quasi-linear approach is that the resulting models are significantly 
simpler than any that could be proposed without knowledge of important aerodynamic effects. 
This approach also reduces the effort associated with identifying the parameters of the model 
since each term can be identified independently (i.e., set all variables to zero except the one 
corresponding to the derivative being examined). For example, Fig. 2-1 shows a plot of 
Q p vs. P for various values of a. This plot suggests that for small sideslip angles, a model 
of the form Q p = K ( a - a 0 )2 may be appropriate. For larger values of P, some 
nonlinearity in p needs to be considered. Also, the effects of dfc and dsp need to be examined. 
Because each derivative is only a function of a few variables, the analysis of important 
nonlinearities and interactions amongst variables is substantially easier than if we attempted to 
formulate a model without any predetermined structure such as the quasi-linear form. It should 
also be clear that the analysis of "small" effects and their ultimate impact on the residual 
generation process is simpler using the quasi-linear model. 
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(non-dimensional) (non-dimensional) 


CROLL VS. BETA VS. ALPHA 



BETA 

(Rad) 

R-6535 

Figure 2- la. Croll vs. Beta vs. Alpha. 


CROLL VS. ALPHA BETA - .04 rad. 



ALPHA 

(Rad) 

R-6536 

Figure 2-lb. Croll vs. Alpha vs. Beta (b = .04 Rad.). 
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2.2.3 Regression Analysis for "Linear” Models 

The quasi-linear models described in subsection 2.2.2 are frequently reduced to models 
that are linear in an unknown set of parameters (e.g., a polynomial model [8]; note that linearity 
in the "independent" variables of the model is not implied). For such models, sophisticated 
iterative regression analyses have been developed ( stepwise, backward elimination, etc., see 
[5]). With such iterative methods, models are iteratively proposed and evaluated until the 
"best" model is obtained. The sophistication of these methods involves the use of calculations 
as part of each regression that help select the next course of action (as opposed to more general 
search strategies that require full model fitting for alternative steps). 

Some controversy as to the definition of a "best" model exists, however. This 
controversy stems from the fact that the ultimate use of the model to be found varies from 
application to application. Some general rules are applicable in many circumstances. For 
example, to paraphrase [8], if two models have similar error characteristics, the one with the 
fewer terms is better. For the residual generation problem, this makes sense since extra terms 
imply extra error due to sensor noise (when residuals are actually formed). However, since 
this is the primary reason for rejecting models with large terms, it is desirable to formulate and 
solve a regression problem that deals with the sensor noise problem directly. This is done in 
the following. 

The regression problem we wish to solve assumes that the residual equation is given 

by, 

v = y m - ( ajxi m + a2 X2 m + ) (2-8) 

where the xj m 's are terms that involve measurable quantities (including nonlinear terms), the 
aj's are coefficients to be determined, and y m is the measurement (of acceleration) that is to be 
predicted. For example, the model for lateral acceleration might be expressed as : 

Vy = a y m - ( ay_p + ay_p p m + ay_p<x P m + . . . ) (2-9) 
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The residual produced within the EDI system from this equation will be nonzero during 
unfailed conditions due to model error and due to sensor noise. 

We now define sensor disturbances that are used to predict the size of the effect of 
sensor errors on the residuals. Let, 

y m = y + n y (2- 10a) 

and, 

xi m = xi + n x j . (2- 10b) 

The characteristics of the terms n y and n x j are determined by the properties of the individual 
sensors used in the residual generation process. In Eq. 2-9 the lateral acceleration noise n ay as 
well as noises on sensors of P, a, and p are considered independent zero-mean white Gaussian 
processes. The characteristics of n y and the corresponding n x j 's are then uniquely 
determined. In this example, they are all trivial except for the ap term which has 

n ap = (P n a + cc rip + n a np) . (2-11) 

Note that while the individual sensor errors may be assumed to be independent, there may still 
be correlation between n x jand n x j due to nonlinearities in the measurable quantities. 

Using the above definitions, the covariance of the residual is expressed as : 

E{vtv) = E {(y-atx^Cy-atx)} + c y 2 + a l Sa (2-12) 

where, a 1 = ( ai, a2, . . . ), x l = ( * 1 , X 2 , . . . ), a y 2 = E { n y 2 }, and [Zlij = E{ n x _i n x j }. 
Now, the first term in Eq. 2-12 represents the modeling error between the quasi-linear model 
and the actual aircraft. If we assume that this error is statistically similar to the model 
simplification error, then Eq. 2-12 can be rewritten as, 

E{ v l v} = (y- Xa )t (y- Xa ) + a y 2 + a*Za (2-13) 
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where N = number of data points, [y]j = the i-th sample of y from the aero-data package, and 
[X]jj = i-th sample of xj from the aero-data. Now, since X can be calculated from knowledge 
of sensor noises and the nonlinearities involved in each xj , E{ v l v} can be minimized by 
choice of a through solution of the linear equation 

(XtX + X)a = Xt y (2-14) 

Equation 2-14 is just a simple modification of the standard regression equations (X = 0 ) and 
can easily be solved. Unfortunately, unlike the standard equations there appears at this time to 
be no method for solution that avoids the computation of X 1 X ■ Therefore, care is needed to 
ensure accurate solutions. 

2.3 SUMMARY 

In this section we have discussed several issues that must be addressed in the 
development of an expanded-envelope residual generator. The adaptation mechanism we 
considered is a model scheduling mechanism as opposed to a model "learning" mechanism to 
avoid the problem of false adaptation to the failures we wish to detect. Effects that need to be 
considered include both large-amplitude maneuvers and changes due to Mach and altitude. The 
effect of large maneuvers at a single flight condition involves nonlinearities and interactions that 
are normally not considered in a linear aerodynamic model (e.g., for control design). 
Significant changes may also occur as a function of Mach and altitude because of the flexibility 
of the aircraft and the effect on load distributions due to flight condition. Qualitative prediction 
of the large maneuver effects is possible through physical arguments involving standard 
aerodynamic concepts. The so-called "static flexibility" effects are less understood and, 
therefore, require explicit scheduling using look-up tables. 

For large maneuver effects, the scheduling is accomplished "implicitly" by construction 
of an analytic nonlinear model. This model is derived as a simplification to a mature aero 
package, although advanced identification techniques could be directly applied to flight test data 
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as well. The development of a useful nonlinear model for the residual generation process 
should incorporate physical understanding of aerodynamics (to avoid complex and/or overfitted 
models) and must consider the effects of sensor noise in determining the utility of individual 
elements of the model. Physical understanding led to a "panel method" model format. This 
format, however, had several drawbacks and led to the consideration of a quasi-linear model. 
This model assumes the form of a linear aerodynamic model, but with "derivatives" that are 
modeled as a function of other variables. The selection of which variables influence which 
"derivatives" is then justified from a physical standpoint When the quasi-linear model is 
further expanded into a "parameter-linear" format, regression analysis can be used to estimate 
the best set of parameters. We then derived a modification to standard regression methods that 
explicitly deal with sensor errors in determining optimal residual generation parameters. 
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SECTION 3 


DESIGN METHODS FOR EXPANDED ENVELOPE OPERATION 

DECISIONMAKING 

In this section, we discuss the issues that must be addressed in the design of an 
expanded-envelope decisionmaking process for the FDI algorithm of [2] and develop methods 
that can be used in the design and evaluation process. As was the case with single flight 
condition designs, we concentrate on the problem of system robustness by adapting a decision 
structure based on design models of residual behavior and select parameters to optimize 
performance with respect to appropriate truth models. 

For this work, we assume that the structure of the decision process has been 
determined and that we desire an adaptation mechanism for the parameters of this process. 
Furthermore, we shall assume that the temporal characteristics of the residuals do not change 
so that the filtering requirements for all statistical tests can be determined a priori. Thus, 
referring to the decision process described in [2], methods for scheduling the projections and 
thresholds of the various statistical tests within that process are sought. 

3.1 DESIGN ISSUES 

The decision mechanism developed in [2] utilizes knowledge about the unfailed and 
failed characteristics of the residuals in order to make accurate and timely failure decisions. 
"Adaptation" is required for full envelope operation because the statistical characteristics of the 
residuals (failed and unfailed) change over the flight envelope and because the design of a 
decision mechanism for "worst-case" scenarios is not adequate (either too low detection 
probabilities for acceptable false alarm rates, or too high false alarm rates for acceptable 
detection performance). 
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As in the design of decision mechanisms at a single flight condition, adaptation is based 
on knowledge about the statistical characteristics of the residuals (under both failed and 
unfailed operation). As in [2], we assert that a statistical characterization of the residuals under 
no-fail conditions is sufficient for evaluating failure detection performance. That is, let F denote 
a vector containing parameters whose changing values cause significant changes in the 
statistical characteristics of the residuals (it is not a trivial problem to determine what F consists 
of and/or provide measures of its components for use in adaptation; these issues are discussed 
at the end of this subsection). The six dimensional vector of residuals, v, is modeled as (see 
[2] , subsection 5.1.2); 

Hq (no failure) : v(t) = n(t; F) (3-1) 

Hi (i-th failure) : v(t) = n(t; F) + Q(F) fi(t) (3-2) 

The notation n(t; F) denotes a stochastic process that represents various kinds of errors 
(modeling, sensor, etc.) whose power spectral density (PSD) is a function of F. The notation 
is somewhat misleading since F changes as a function of time, thereby making the notion that 
the residual PSD is a function of F incorrect However, if F changes slowly with respect to the 
FDI time scale this characterization is valid for design (this is not always the case; e.g., 
increases in low frequency error at high angular rates; thus caution must be used in 
interpretation of performance results). 

In the design of the single flight condition decision mechanism, the statistical charac- 
teristics of the residual errors under no-failure conditions and the direction of the failures in 
residual space were mapped onto decisionmaking parameters using a well defined design 
methodology. Equations 3-1 and 3-2 imply that the first step in adaptive decisionmaking 
design is the characterization of the statistics of the unfailed residual errors n(t; F) and the 
characterization of the failure directions Q(F)/ II Q(F) II (defined as e(F) in the remainder of this 
section). 
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Several factors affect e(F) and the statistics of n(t; F). For example, situations that 
result in variations in the statistics of n(t; F) include : 

1 . The effect of sensor noise on the broadband energy content of the residuals is 
modulated by the size of the aerodynamic derivatives and the value of q. This is 
because the residual model contains products of derivatives, q and sensor 
measurements. At higher q, and for larger derivatives, the variance of the white 
noise portion of the residues would be expected to increase. 

2. Scale factor errors and sensor misalignments result in low-frequency or in-band 
errors. The size of this effect is also dependent on the size of appropriate 
derivatives and q with larger values implying larger residual variances. 
Misalignment errors are also a function of the size of maneuvers. 

3 . When model error is adequately characterized by an error (additive or multiplicative) 
in the derivative factor, then larger low-frequency errors are expected for large 
maneuvers. This includes maneuvers due to pilot commands, and large departures 
from steady flight due to disturbances (e.g., turbulence). 

4. The residual model is based on static airflow and therefore errors during transients 
are expected. The errors are transient in nature, but could be considered low- 
frequency with respect to the FDI bandwidth. 


Situations that result in variations in e(F) include, in principle, anything that can cause 
the control derivatives, Q (F), to change. However, there are cases in which Cj(F) is not 
constant, but where the failure directions remain fixed. In these cases, adaptation is 
unnecessary. A two-dimensional example is given below. 

Let a two-dimensional residual, under failed conditions (no uncertainty), be modeled 
by, 

Vl = Cl gi f (df, F) - Cl gi m (d m ; F) (3-2a) 

v 2 = c 2 g 2 f (df, F) - c 2 g 2 m (d m ; F)(3-2b) (3-2b) 

where df and d m are the actual and measured control element values and gf and g m are actual 
(failed) and modeled control nonlinearities. The failure direction is defined by tan'l( vi/ v 2 ) 
and is a constant when 

ci ( gl f - gl m ) / c 2 ( g 2 f - g 2 m ) = constant (3-3) 
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For example, gjf = gj m = Kj(F) + g(d; F) satisfies Eq. 3-3. Thus, when control nonlinearities 
are the same in all axes, the failure directions remain constant and adaptation is not required. 

A more problematic situation arises when the i-th failure direction changes as a function 
of the i-th control element deflection (i.e., one component of F is 6; ). Recall that the term 
adaptation in this project refers to a scheduling of design parameters as a function of 
measurable or estimable quantities . Now, if the failure directions" can not be estimated or 
measured, adaptation is not possible. This is precisely the case when the i-th failure direction 
changes as a function of the i-th control element deflection. To see this, consider Eq. 3-2 
again. Now, unless the functional form of the control derivative vectors satisfies Eq. 3-3, the 
left hand side of Eq. 3-3 (the failure direction) will be a function of the unmeasurable quantity 
df. If this effect is significant, and the performance obtained by assuming it is negligible is not 
adequate, then decision mechanism concepts that are radically different than those described so 
far may be required (e.g., more explicit failure-mode modeling, or the use of probe or dither 
signals for enhancing identifiability). 

The extent of this situation was briefly investigated using the AFTI-F-16 model 
provided by NASA. Figures 3-1 through 3-6 are plots of the aerodynamic coefficients for 
NASA's F-16 model at h = 15,000 ft and M = 0.6 versus the deflection of a single control 
element (dfl, dhtl, and dr) with all other variables (other control elements, a, p, and angular 
rates) set to zero . These figures show that in all but a few cases, control effectiveness is linear 
for a substantial portion of the deflection range. The exceptions include C x for all control 
elements (as one would expect from physical principles; i.e., drag > 0) and the pitching 
moment (C m ) due to flaperon deflection (dfl). Since, from past experience, C x carries little 
information for detecting and isolating these control surfaces, there is little lost in eliminating 
C x from consideration. Thus, the only problematic situation is the C m vs. dfl nonlinearity. 
Figure 3-7 shows a plot of the Qn direction-cosine as a function of dfl for various values of 
dhtl. This plot shows that the failure direction for dfl changes with dfl deflection, and that this 
change interacts with dhtl deflection. Thus, we can not make use of the pitching moment 
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Figure 3-1. CxCyCzvs. DFL (all=0). 
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Figure 3-7. Pitch Moment Direction Cosine vs. dfl vs. dhtl. 

residual for detecting or isolating dfl without further analysis of the impact of any simplifying 
assumptions that would need to be made (e.g., assuming C m vs dfl is linear, or zero). 

The above discussions have outlined some of the factors that might affect the statistical 
characteristics of n(t; F) and the failure directions e(F). The components of F should therefore 
be based on these factors either directly (e.g., by scheduling with q, p, a, etc.) or indirectly. 
Although time did not permit a complete investigation of the appropriate composition of F for 
the AFTI-F-16, some general ideas can be developed. First, changes in the failure direction, 
e(F), can only occur as a function of those factors that also affect the corresponding control 
"derivatives" in a quasi-linear residual generation model. Therefore, the residual generation 
model provides a basis for identifying these factors. Plots of direction cosines vs. various 
factors can point to those factors that most influence failure directions and measurements of 
these factors may then be used to schedule those decisionmaking parameters that are affected 
by e(F). Secondly, some of the changes in the statistics of n(t; F), may also be derived by 
reference to the residual generation model. For example, dynamic pressure clearly has a direct 
influence on the size of the impact on additive sensor errors and should therefore be one factor 
upon which to schedule those decisionmaking parameters that are influenced by n(t; F) 




characteristics. Similarly, significant changes in the size of the "derivatives" in a quasi-linear 
model may also influence the extent of the impact of additive sensor errors on residual errors. 
Some effects, however, are not easily characterized through reference to the residual generation 
model. Primarily, these are the effects that are modulated by the size of maneuvers (e.g., aero- 
model error, scale-factor error, misalignment error). One way to overcome the difficulty 
associated with characterization of these types of errors is through an empirical approach. In 
such an approach, a high fidelity simulation or data from a flight test vehicle would be 
processed to generate residuals (as we did in [2]). Flight condition elements (components of 
F) might include, in addition to the obvious factors such as q, a specification of the size of the 
"inputs" (pilot inputs and wind disturbance) to the aircraft. Measures such as RMS stick 
deflection and RMS a- vane and (3-vane movement (over an appropriate window) could then 
serve as "measurable" factors upon which scheduling may be based. Statistical 
characterizations of residual error can be computed from observations of the residuals and the 
parameters of such a characterization correlated with the RMS input measures. 

Having characterized both e(F) and the statistics of n(t; F), we can then concentrate on 
the mapping from the statistics of n(t;F) and e(F) to the decisionmaking parameters. If a simple 
analytic mapping were available, the design process would now be complete (with the analytic 
calculations done on-line as a function of measured/estimated values of F). However, the 
mapping from the statistics of n(t;F) and e(F) to the decisionmaking parameters is sufficiently 
complex to require the consideration of methods of simplification that directly produce decision 
parameters as a function of F. Analytic methods for performing this part of the design process 
are considered in the next subsection. 

3.2 DESIGN METHODS 

In this subsection, we develop several methods for simplifying the relationships 
between a set of flight condition parameters, F, and the parameters of the decisionmaking 
process. In reference to the decision process of [2], the decisionmaking parameters that must 
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be specified include projection vectors and thresholds for the various hypothesis tests that must 
be performed. In principle, the filtering requirements for each test might also be specified; 
however, for this project, we have assumed that these requirements will not change over the 
flight envelope and therefore concentrate on threshold selection and projection vector design. 

In the following, a general design procedure is developed in which various design calculations 
are made. These calculations utilize many of the techniques discussed in [2] and will be 
referred to throughout this subsection. Methods for performing the relevant calculations are 
then provided for fixed sample size tests. Methods for designing sequential tests are the same 
for projection vector design; however, as discussed in [2], sequential test threshold design 
must use heuristic methods. 

3.2.1 General Methodology 

The main goal of this methodology is to develop a mapping from F to the 
decisionmaking parameters (thresholds and projection vectors) that is neither overly complex 
so as to require extensive amounts of computer time and/or memory nor too simple such that 
performance may be sacrificed. In general, threshold and projection vector selection are treated 
in a similar manner to the single flight condition design process. Having specified the filtering 
requirements of a particular test, selection of "optimal" (or near-optimal) projection vectors is 
performed. This selection process uses the n(t; F) and e(F) characterizations as the "truth- 
model" upon which performance is to be optimized. Having chosen the projection vectors, 
thresholds are then chosen to achieve acceptable decision-error characteristics. 

The general design process attempts to strike a balance between the extremes of 
oversimplification and excessive complexity. At the simple end of this spectrum is a design 
that ignores all changes in n(t; F) and e(F) and employs a single set of (best) parameters. 

Should such a design achieve acceptable performance levels it is clearly the preferred solution. 
On the other end of the complexity spectrum is a design that specifies parameters at each of 
many values of F (i.e., many single flight condition designs) and performs interpolation of 
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these values when the actual F lies between the scheduling points. This method comes closest 
to optimal extended-envelope design, but will miss the fact that many of the schedules may be 
unnecessary. Thus, we seek a design method that can strike a balance between the simple 
" fixed-parameter " solution and the complex " variable-parameter " solution to come up with a 
partial " fixed/variable parameter " design. The key question to be answered in the development 
of a fixed/variable design is then "Which parameters can be fixed and which must vary to 
achieve adequate performance?" 

Figure 3-8 shows an overview of the general design process. The process involves 
four basic steps progressing from the simplest design (fixed parameters) to the most reasonable 
tradeoff between performance and complexity in a partially fixed/variable design. Evaluations 
are made throughout the method to assess the impacts of simplifications in terms of 
performance reduction with respect to both the performance goals and the variable parameter 
design. 

The first step in the process is to design and evaluate a fixed parameter system. Varia- 
tions in e(F) and n(t; F) are taken into account in selecting a single best set of parameters for all 
values of F. Evaluations with respect to performance averaged over all values of F are made 
and compared to the design goals. If detection of important failures within reasonable amounts 
of time without too many false alarms can be achieved, then the fixed parameter system may be 
used and no scheduling is required. However, if the performance tradeoffs are unacceptable 
(e.g., thresholds set to avoid false alarms result in inadequate detection capability), continued 
development is needed. 

The second step is the development of a completely variable design. In this step, a new 
set of parameters at every value of F (although F may be continuous valued, we assume 
continuity of its influence on n(t; F) and e(F) so that samples of F at appropriately spaced 
points will provide an adequate approximation to the continuous relationship between F and the 
design parameters) is computed . Evaluation of this design is made and used as a bound to 
performance levels achievable in any fixed/variable designs. 
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The third step is taken if the variable design in step 2 is of sufficient complexity to 
warrant simplifications (note that no performance improvements over the step 2 design are 
possible with this procedure). In this step, the variations in the design parameters are 
examined and those variations that are deemed insignificant are selected as fixed parameters and 
a fixed/variable design is performed. The resulting design is evaluated and compared to the 
variable-parameter design and the design requirements to determine: a) if the design is 
acceptable (in terms of performance and simplicity), and b) if the selection of fixed parameters 
should be extended or another set chosen. The evaluation must occur because of the fact that 
what appear to be small variations in qualitative terms when selecting fixed parameters may 
actually represent important variations in terms of performance (this is due to the unequal 
scaling of the residuals). 

The last step involves simplification of the relationship between F and those decision- 
making parameters that must vary as a function F to achieve adequate performance. This step 
is only necessitated if on-line data restrictions are such that storage of decisionmaking parame- 
ters at the various design points (Fk) (and subsequent interpolation between points) is not pos- 
sible. As in the case of residual generation models, this last step involves model selection and 
regression analysis to fit a closed form approximation to the desired relationship. Note also 
that such a methodology can also be used to reduce the number of points in a look-up and 
interpolate model. 

The general methodology has several computational requirements both for design and 
evaluation. In the next four subsections, details of these calculations are provided. First, 
methods of evaluation for any decisionmaking design are treated, and then methods for 
optimizing performance over the entire envelope are discussed. 

3.2.2 Evaluation Methods 

This section presents an evaluation method that can be used in the general design 
method discussed in the previous subsection. Many of the detailed calculations are similar to 
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those reported in [2] and proofs are therefore not provided in this report Furthermore, we 
treat only fixed-sample size hypothesis tests (i.e., trigger tests). The design of sequential tests 
(verify and isolate tests) must follow ad-hoc procedures as in [2]; however, these procedures 
are typically based on fixed-sample size test designs so that the presentation below can be 
easily adapted. We also only deal with detection tests in the following (trigger and verify 
tests). Isolation tests can be treated in a similar manner as was done in [2]. 

For this development, we assume that the residual vector, under no-failure (Ho), at the 
k-th flight condition, F^, is modeled by the residual error "noise" n(t; Fk), while during 
failure of the i-th control element (Hj) at the k-th flight condition the residual can be modeled by 

v = Cj (k)-f- + n (t; F^j (3-4) 

(Note thatEq. 3-4 assumes a constant failure signature. Methods for dealing with other 
temporal characteristics are derived in [2], Section 4). The hypothesis tests that need to be 
designed and evaluated all take the form 

Decide Hi if s(k) > t(k) 

Decide Hq if s(k)<t(k) (3-5) 


where 


and 


s(k) = | Pt(k) v f | 

Vf = filtered version of v. 


(We use the notation ”x(k)" to indicate dependence of x on Fk). 

Given the statistical characteristics of n(t; Fk), the covariance matrix of Vf , Ef (k), can be 
derived. Thus, under no-failure, s is zero mean with variance given by 


a^(k) = P t (k)Z f (k)P(k) 


(3-6) 
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Under Hj, the statistic, s, has a nonzero mean and variance given by 


Sj(k) = fP l (k)Cj(k) (3-7) 

c 2 (k) = a 2 (k) = c 2 (k) (3 . 8 , 


Now, the above equations give the (assumed Gaussian) probability density function for the 
statistic, s, at each flight condition. For evaluation, however, we need to summarize 
performance over all flight conditions. For this work, we propose to use average (over all 
flight conditions) values of relevant performance measures such as detection probability for a 
given failure signature, minimally detectable fault-signature for a given level of detection and 
false alarm probability. Alternate measures (to averages over all flight conditions) include the 
worst-case values or squared-mean-minus-variance values (for those measures that should be 
maximized) and mean square values (for those that should be minimized). For average values 
the relevant equations are; 

Average ''Signal-To-Noise" 


d 2 =2> k d 2 (k) 

k 


where 


d 2 («= 


(lp(k) T Cj(k)) 

2 

C(k) 


Average Minimal-Detectable Failure 


fmin - S ^k^minCk) 
k 


where 


(f min (k) |P(k) l C(k) | -t(k) 


2 

C7 (k) 


= <2>d) 


and, 


(3-9) 


(3-10) 
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Average Probability of False Alarm 


(3-11) 


I 

I 

I 


p fe= 

k 


(M 


\<y 2 (k)j 


In the above, Ttk represents a weight associated with the k-th flight condition, Q _1 (£) is the 
inverse of the Gaussian error function, and Pd is the desired detection probability. Note that 
Eq. 3-9 does not include evaluation of the selected t(k) since it presumes that t(k) is selected to 
realize a tradeoff between false alarms and missed detections that is specified by d 2 (k). 

3.2.3 Variable Design Method 

The simplest design procedure is that used in the variable design. This method is 
tantamount to several single flight condition designs; one for each value of Fk. Thus the 
methods discussed in [2] are used at each Fk- The relevant equations are: 


P(k) = 


Zf (k)Ci<k) 
II C|(k) II 


( 3 - 12 ) 


t(k) = c2(k) Q-l (P fa deseed) (3-13) 


These values can then be used in Eq. 3-9 or 3-10 to evaluate the design. 

3.2.4 Fixed Parameter Design Method 

The next simplest design procedure is the fixed-parameter system. This method tries to 
select a single optimal set of values for all flight conditions. Thus, P(k) = P and t(k) = t for all 
k. To choose P, we would like to optimize d 2 (as in [2]) as given by Eq. 3-9. Rewriting 
Eq. 3-9 to highlight full the dependence on P we have 


d 2 =X 7 t k- 

k 


P Q(k) Cj(k) 


[ZfW] 


if 2 


(3-14) 
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Unfortunately, unless Xf(k) is a constant, the optimal solution of Eq. 3-14 for P is not closed- 
form, [9]. Thus an alternate performance measure is desired. One way to solve this problem 
is to use a modification to Eq. 3-14 that represents the ratio of average mean of s (over all 
flight conditions) to average variance of s, namely, 


P T R C P 
P T S f P 


where 


(3-15) 


R c =X*kCi(k) Ci ® 1 


k 


(3-16) 

(3-17) 


It is easy to show that this measure is maximized by 

.1 

P = S f 2 V 

where V is the eigenvector corresponding to the smallest eigenvalue of the matrix 


-I -I 

I f 2 R c l ’ 2 


(3-18) 


Another way to solve the problem is to treat F as a random variable taking on values Fk with 
probability 7tk . Then, approximate Gaussians are used to model the weighted sum of 
Gaussians densities that characterizes s over the entire flight envelope, for each hypothesis 
(failed and unfailed). Even if the Gaussian densities with the same mean and variance are 
used, the result is another optimization problem that has no closed form solution. Therefore, 
this method is not considered further. 

Now, to select the single best threshold, we try to achieve low false alarms at all flight • 
conditions. Thus choosing t to minimize Eq. 3-11 would be desired. Unfortunately, the 
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solution can not be expressed in closed form (even if standard approximations arc made to the 
error function) and is, therefore, deemed inappropriate for this effort. If we use the average 
variance to characterize the variations under all flight conditions, however, a reasonable 
selection of t can be made from 


Q 


t \ 

£a 2 (k}jt k 
k / 


~ Pfa desired 


(3-19) 


3.2.5 Fixed Plus Variable Design Method 

In this design stage, we wish to fix some of the parameters of the decisionmaking 
process as a function of flight condition, Fk, and allow others to vary. Such a design allows 
compromises between performance and complexity to be made. For this development we will 
refer to Pf and P v (k) as the fixed and variable parts of the projection vector, P(k), respectively 
and similarly for tf and t v (k). 

Threshold setting requires definition of P(k) and is straightforward. For those Fk that 
require different thresholds, Eq. 3-13 is used. Those Fk for which a single threshold is 
desired can be treated using Eq. 3-19, where the sum over k represents only those flight 
conditions for which a single threshold is desired. Deciding which flight conditions need a 
separate threshold, and which can be grouped together with a single flight condition is not 
treated in any detail in this report. However, we observe that a single threshold will be 
sufficient for all those values of F (and P(k) ) that result in variances for s that are nearly equal. 

Choosing fixed and variable portions of P requires, as in the fixed design method, a 
measure of overall performance that is both relevant and functionally related to P v and Pf in 
such a way that either closed form solutions or straightforward optimization procedures can be 
used ( although elaborate solution methods may be available, it is not deemed of sufficient 
importance to the overall design problem to warrant the attendant development effort). To 
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illustrate the idea of fixed plus variable design, consider a case in which Ef(k) is constant and 
equal to the identity matrix. In this case we have. 


d 2 (k) = 


P v (k) T Cj'(k) + Pf C-(k) 


■a 


(3-20) 


2 2 

To maximize d = Ea^d (K) requires that we first maximize each d(k) resulting in optimal 
values of P v (k) as a function Pf. Then we can solve for the optimal Pf , (this is because the 
P v (k)'s affect only d(k) ). In a three residual system, for example, d(k) is 

d(k) 2 = [P i [C] ! + P 2 [C] 2 + P 3 [C] 3 ] 2 (3-21) 


In Eq. 3-21, the notation [C]i denotes the i-th element of the vector Q(k) and the dependence 
of the elements of the [C]i on has been suppressed, and Pj is the i-th element of P(k). Now 
suppose we allow Pi and P 2 to vary with k and require P 3 to be constant Then maximizing 
Eq. 3-21 by choice of Pi and P 2 (with the usual II P II = 1 restriction) gives. 


Pi = 


[Ch 


([C]?+[C]| 




(3-22a) 



(3-225b) 


(We only need to maximize P V T Q v since d 2 (k) is monotonic in this term). Substituting into 
Eq. 3-21 gives, 



(3-23) 


Taking the average over all flight conditions gives an equation for P 3 of the form 
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d 2 = A 1 (l-P|) + A 2 P 3 (l-P |) 2 


(3-24) 


+ A 3 p 3 


To maximize Eq. 3-24 the relevant gradient equation is 

.1 1 

-2A 1 P 3 -A 2 P3(l-P3) 2 + A 2 (l-p | 2 + 2A 3 P3=0 (3-25) 

This equation is a transcendental one in P 3 and can be solved by standard iterative methods 
(e.g., Newton's method). 

Now, when Xf(k) is not the identity at all flight conditions, the situation is substantially 
more complex. Closed forms for this general case were not derived for this project, and so an 
ad-hoc procedure is now proposed. Suppose that instead of choosing the optimal value of Pf 
we select Pf to be some specific value (e.g., zero or the average over all values in a variable- 
parameter design). Given this selection we would like to optimize Eq. 3-9 through choice of 
P v (k). However, a closed form solution to this problem is not immediately obvious. 
Therefore, we choose P v (k) to optimze a d 2 metric in the reduced subspace of residuals 
corresponding to the variable elements of P. If we let Xf (k) be the covariance of the filtered 
residuals in this subspace, then the solution is 

P v (lc)~£t(k)' 1 Ci , (k) (3-27) 

and the result is normalized so that P has unit norm. 

3.3 SUMMARY 

In this section we have discussed various issues in the development of an adaptive 
decision mechanism (DM) for control element EDI. We assumed that the structure of the 
decision process was predetermined and that only the parameters of this process are to be 
"adapted." As in Section 2, the adaptation mechanism is a "scheduling" concept in which the 
decisionmaking parameters are changed as a function of "on-line" measurable flight-condition 
quantities. We also assumed that the temporal characteristics (i.e., spectral shape) of the 
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residuals are constant so that filtering requirements for each hypothesis test do not need to be 
scheduled. 

Scheduling of DM parameters is potentially required whenever changes to the 
covariance of the filtered residuals occur and whenever changes to the failure directions occur. 
The former requires changes to both thresholds and projection vectors while the latter only 
requires changes to projection vectors. Although failure directions mav change whenever the 
control derivatives change, if these changes effect all derivatives in a similar manner, then the 
failure directions remain constant. When all derivatives are not affected in a similar manner, 
scheduling of the projection vectors must occur. However, this is only possible if the . 
parameters affecting the failure directions are measurable. Such is not the case when a failure 
direction is affected by its corresponding control element value. Should this occur (as it does 
for the flaperons on the F-16), care must be taken in the design of tests for flaperon failures 
(particularly in using the pitching-moment residual). 

The measurable quantities upon which scheduling must be based include dynamic 
pressure, roll rate, and angle of attack, since their values has a direct impact on the sensor noise 
component of the residuals. However, other effects, such as those that are modulated by 
maneuver size are more difficult to describe. One way to establish scheduling requirements for 
these effects is to perform an empirical study (using either a high-fidelity simulation or flight- 
tests) and to schedule parameters as a function of the "size" of aircraft "inputs." 

Once the flight-condition parameters are defined, the DM design goal becomes one of 
balancing complexity and performance of the scheduling mechanism. The simplest DM design 
is a fixed-parameter solution and should be used if its performance is adequate. At the other 
extreme is a DM design in which all parameters must be scheduled. In between these extremes 
a partial fixed/variable design allows for some parameters to be fixed and some to vary as a 
function of flight condition. Design and evaluation methods were given for all three DM 
design concepts. 
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SECTION 4 

RESIDUAL GENERATION FOR THE AFTI/F-16 


4.0 INTRODUCTION 

A key component to developing an aircraft-path FDI algorithm for expanded envelopes 
of operation is a residual generation process that is adaptable over a large range of flight 
conditions. Such a residual generation process must provide accurate estimates of the aircraft 
during normal flight and also during large scale maneuvers over a wide range of velocities and 
altitudes. To achieve a high level of accuracy in the prediction of the aircraft behavior, it is 
imperative that a high fidelity model of the aircraft be synthesized. 

The purpose of this section is to build an expanded envelope, nonlinear residual 
generator and demonstrate its improvement over the single flight condition, linear residual 
generator. This process will be demonstated for a NASA AFTI/F-16. The general design 
methods and selected approach to the residual generation process were described in Section 2. 
The general method that will be used includes modeling the aircraft at various fixed flight 
conditions, but over a broad range of motions. Several models, developed in this manner but 
at different flight conditions, will be scheduled to account for the full operating range of the 
aircraft. (For this demonstration, however, only one model at a single flight condition was 
developed.) The selected approach for developing high fidelity models utilizes a nonlinear/ 
quasi-linear model (basically a polynomial of nonlinear functions, each of which can be 
reduced to a summation of "coefficents" times "predictors") and a regression analysis based on 
that model, as detailed in subsections 2.2.2 and 2.2.3. 

Due to the limitations in scope of this project, several assumptions and simplifications 
were made. One of these simplifications, as mentioned above, is the development of only one 
nonlinear/quasi-linear model instead of the many that are required for full adaptability of the 
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residual generator. It was also decided to model only the roll moment axis, with the assump- 
tion that any results obtained could be similarly extended to any of the aircraft's other five 
degrees of motion. Other assumptions were made to reduce the complexity of the modeling 
process, such as simplifications to the sensor noise model, limitations placed on control 
deflections, etc., which are all explained in more detail in the sections below. 

Despite these simplifications to the residual generation design, promising results were 
obtained from the test runs. It was clearly shown that a quasi-linear approach in formulating a 
nonlinear model resulted in much more accurate residuals than the standard linear model. In 
addition, the sensor noise computation method proved to be a workable concept despite lew 
enough sensor noise levels that warranted exclusion of the actual use of the concept The 
regression analysis showed that further reduction of the number of terms may be plausible, 
given that effectively no accuracy was lost in the reduction from 31 predictor terms to 22 
predictor terms. Finally, avenues exist for further refinement through actual implementation of 
multiple flight condition models (which was not realized due to time constraints) and modeling 
of predictor terms as piecewise-linear models. 

4.1 MODEL DEVELOPMENT 

One of the primary goals in the development of the residual generation process is to 
determine the terms for inclusion in the quasi-linear equations of motion, or more specifically, 
the equation for the coefficient of rolling moment. These terms, if chosen judiciously, will 
provide a far better representation of aircraft behavior in multiple-flight condition sorties than 
the standard linear model. Until now, there had been no set method for choosing these terms. 
The method that is presented here for choosing the terms is based on the nonlinear/quasi-linear 
model detailed in subsection 2.2.2. Subsection 4.1.1 presents the approach that was taken to 
select the terms, including a description of the quasi-linear model and an outline of the steps in 
the prescribed method. Subsection 4.1.2 discusses the application to an F- 16 of the method 
developed in the previous section, covering the selection of the potential predictor terms, and 
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presents the final terms that were chosen for the residual generation models. For such a 
method to be developed, many auxiliary issues also must be addressed. These include the 
development of a sensor noise model and computational isssues, such as sampling. These 
two topics are discussed in subsections 4.1.3 and 4.1.4. 

4.1.1 TheApproach 

The method used to develop an accurate model of the aircraft incorporates aspects of the 
nonlinear/quasi-linear model as described in subsection 2 . 2 . 2 , thus, a good understanding of 
the implementation of this model is necessary. A brief overview is provided here. 

The quasi-linear model represents an aerodynamic, non-dimensional coefficient (in this 
specific case, the rolling moment coefficient, Q) as a summation of nonlinear functions 
multiplied by a corresponding independent variable, namely, 

Ci=Sc, Vi¥i (4-1) 

i 

where xjq are the measurable quantities that are likely to affect Q and each Cj\j/. is a nonlinear 
function, the derivative of Cj with respect to \|/j . The above equation is a more specific version 
of Eq. 2-6. This polynomial can be simplified further if each term of the polynomial is 
expanded into a summation of coefficients multiplied by a reduced term (a predictor) such that, 

c iVi’ Vi= f vi( x i’ x 2> x 3--- )- Vi 

= gi( x l)* Yi+g 2 M* Vi+g3( x 3)- Vi ••• (4-2) 

where xj,x 2 , X 3 , etc., are arbitrary classes of "causal" variables of the nonlinear function,/; 
\|/j are the measurable quantities mentioned above; and gj (xj) is an n-th order polynomial in x 
(n to be determined later), that is, the contribution of the derivative , Cpj/j , due to xj. The 
order of the polynomial g(xj) is determined by xj's influence on the corresponding derivative. 
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A high order polynomial implies that all lower order variables are also required. Thus, the 
quasi-linear model can be concisely summarized as a polynomial, 

C^XaixIVi (4-3) 

where Xi n is an n-th ordered variable, called the "causal" variable, such that if xj n exists, then 
all lower order variables of Xj also exist, and aj is the "regression coefficient". 

Clearly, given the arbitrary nature of xj, it would be extremely difficult to try all 
combinations of possible independent variables of indeterminable order with each derivative. 
Thus a method was required to select the candidate nonlinear terms, that is, the nonlinear * 
derivatives. From these candidate terms, the proper predictors (defined as the combination of 
xpiq ) and their complementary coefficients can be deduced. 

The choice of the quasi-linear candidate terms was accomplished by a deliberate 
approach that also required intuitive reasoning. This approach requires intuitive reasoning to 
create an original list of potential terms, which are selected based on aircraft dynamic properties 
and studies of sensitivity plots. These terms are reduced to potential predictor terms. A 
backward elimination regression analysis is then used to eliminate these potential predictor 
terms in the model one at a time. This elimination process is based on a figure of merit (FOM) 
of the predicted residual error variance. 

The following steps outline the method that was developed to characterize the behavior 
of the AFTT/F-16: 

1 . Select causal variables - A general form of the aircraft equations of motion is taken as 
a starting point. Using the quasi-linear model approach, one variant of the aircraft equation of 
motion is an unrestrictive equation, such as equation (4-1) above. As noted in the equations 
describing the quasi-linear model (equations 4-1 to 4-3), the "predictor" is defined as consisting 
of two independent variables, y and x. In equation 4-2, the variable y is combined into the 
derivative Cp|f, which is a function of many independent variables x. These x variables are 
called "causal" variables, that is, they cause the derivatives, Cjy, to vary. Although both the 
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causal variable and the independent variable, \j/, are predictor-type variables (and thus, a case 
could be made to form the derivative Q x instead of Cpy), a causal variable is differentiated from 
\| / in that the causal variable is a variable that is not traditionally associated with predicting the 
dependent variable in question, i.e., the non-dimensional coefficient, Q. The independent vari- 
able will always be the more influential of the two, the one commonly associated with the depen- 
dent variable. For example, if Cjp is a function of a, then a would be referred to as the causal 
variable, p would be referred to as the independent variable, \jr, (since Qp is a common deriva- 
tive whereas Ci a is much less common) and Q would be referred to as the dependent value. 

The candidate nonlinear terms are drawn from physical explanations of the aircraft 
behavior. For each candidate term, a reasonable and workable list of causal variables are 
selected. This can be based solely on dynamic or static characteristics of the aircraft, or it may 
be empirically gathered from flight data. From this reduced set of nonlinear functions, simpli- 
fications can be made to the polynomial, as in equation (4-2), to arrive at the set of potential 
"predictors", or more accurately, "the class of predictors" (since for each class of predictors, 
xi n \j/i n , many combinations of predictors may exist). Each potential predictor's composition 
varies from linear terms (where no causal variable exists), to cross terms (where the causal 
variable is different from the independent variable, \j/), to single variable, higher order terms 
(where the causal variable is the same as the independent variable.^). The terminology used 
in the quasi-linear model development is summarized in the partial example below: 


predictor term 



Ci = Cep • a • p +c 8 FC p- S FC - P + — (4-4) 

T T T T 

non-dimensional regression causal independent 

aerodynamic coefficient coefficient variable variable 

V loo ^ 
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2 . Plot derivative sensitivities to causal variables - For each suspected class of 
predictors, a plot of variations in the derivative over different values of the causal variables is 
made. For example, if collective flap deflections are suspected of affecting the coefficient of 
rolling moment due to (5, then plots would be made of the coefficient of rolling moment due to 
(3 at several collective flap deflections. 

3 . Determine predictor terms - Each plot is analyzed to determine if the suspected 
causal variable actually changes the derivative value in question. If the plot shows a constant 
derivative value for all causal values, then the suspected class of predictors is removed from 
consideration. If, however, the plot varies, then the highest ordered effect of the causal 
variable must be determined through inspection of the plot. It is assumed that for a predictor 
whose causal variable was assigned order n, that predictors with causal variables of less than n 
will naturally exist. 

From analysis of the plots, a list can be generated to separate all suspected terms into 
either large effects, small effects, or no effect. 

4 . Perform backward elimination regression analysis - With the predictors deduced 
from the above steps, a backward elimination regression analysis is implemented. Briefly, the 
backward elimination starts out by attempting to fit all predictors to the dependent values. After 
each regression step, the least influential predictor term is removed and the regression is 
repeated. This will continue until a manageable number of terms remain. One criterion used 
for deciding the number of terms to keep is the requirement that the sample variance of the 
nonlinear model have significantly better results than the linear model. 

4.1.2 Application to F-16 Rolling Moment Model 

This section describes the actual procedure used in developing the AFTI/F-16 nonlinear 
model. Since we will only concentrate on the rolling moment for demonstrating the 
effectiveness of an extended envelope residual generator, only the L-axis predictor terms are 
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eventually derived. The step numbers listed below correspond to the steps itemized in the 
previous section. 

Step 1 - Select causal variables 

The first step to creating a nonlinear model for the F-16 is to take a general form of the 
non-dimensional rolling moment coefficient and select from this equation the set of possible 
candidate nonlinear terms. Preferably, most of the candidate terms chosen will be deduced 
either directly from intrinsic qualities of the aircraft or from sets of terms used in other studies. 
For this specific task, terms were drawn from both sources. 

An initial list of candidate terms was first compiled based on the theories of aircraft 
dynamics and control as detailed in Roskam [6] and McRuer [10]. From these sources, the 
rolling moment aerodynamic coefficient can be summarized in quasi-linear form as: 

Ci = ^(Ci p (a) • p + C, r (a) • r) + C, p (a, 8 FC , 5 sp , p ) • p 

+ ^SFA^’ ^ FC ’ ^ FA )* ^ FA+Cl SHTA( a ’ ^ FC ’ ^ FA 1* 

+ C l 5r ( a , 5 FC» 5 r )' 5 r +C l 6 vc (a, P,8 V c )• S V C ( 4 _ 5 ) 

The following gives a short explanation for the various causal variables of the nonlinear 
terms of the equation. The angle of attack affects all the derivatives because of its influence on 
the effective lift of the wings, which grows with increasing alpha below separation. The 
collective flap deflection is a factor in many of the derivatives due to its contribution to the 
altering of the effective camber of the wing. The tail derivatives are additionally affected by 
downwash caused by the flap deflections. The P derivative is also affected by the canard 
deflection, which adds an asymmetrical side wind component due to its location. 

Each nonlinear derivative was then reduced to two-variable cross term predictors with 
indeterminable order. For example, 
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Cjp(a, 8 fc» 5 sp , P )- ^ip (a) + Cjp (8 fc ) + Cjp (8 S J + Cip (p) (4-6) 


Of course, interactions involving more than two variables exist physically, but, as the results 
later will show, very accurate modeling can be attained by using only two variable cross-term 
predictors. This assumption, in effect, simplifies the model and limits the amount of coupling 
between variables to two at a time. The full list of the resulting Aero- "Derivatives" are shown 
in Table 4-1. 


TABLE 4-1. AERO-MODEL 'DERIVATIVES" 


Ci r (a) 


Cip (a) 

c lp ( a » 5 FC’ 5 sp’ p) 

= C lp( a ) + C lp( 5 Fc) + C lp( 5 sp) + C lp(p) 

Cl S FA ( a ’ 5 FC’ 5 fa) 

= c is F J a ) + Ci s fa ( 5 fc) + c i 5 fa ( s fa) 

5fC ’ 5pA ) 

= c O’“' +Ci sJ 5fc ) +C| sJ 5fa ) 

Ci 8i M F c.S r ) 

= C, 5 (cx) + c, s (8 fc ) + C, s (s r ) 

C >5vc(^ t ’ ^ ’ ® vc ) 

= c i s J“) + c i 5 JP) + c <sJ 5 vc) 


Step 2 - Plot derivative sensitivities to causal variables 

A software package supplied by NASA Langley was used to generate data for plots of 
the effects of a suspected causal variable to a derivative. This software package produced 
aerodynamic coefficients modeled through look-up tables of the F-16. Since the output of the 
aerodynamics package gave the non-dimensional rolling moment coefficient and not the desired 
derivatives, each plot was actually a multiple plot graphic representing variations of two 
independent variables, the derivative-related, independent variable, y, and the suspected causal 
variable. For example, for a coefficient of rolling moment due to P, Qp, (i.e., the variation of 
the dependent variable with respect to the independent variable) that is suspected to vary with a 
(i.e., the causal variable), the independent variable, P, would be plotted along the x-axis, but 
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there would be multiple plots of the rolling moment coefficient, one for each selected value of 
a. The independent variable, that is, p, was varied over the maximum range of possible 
values, e.g., -5 degrees to 5 degrees, while the suspected causal variable, that is, a, was set at 
five typical values (based on the flight tables generated from the simulation by NASA, 
e.g., -10, 0, 10, 20, 30 degrees). The plots of all suspected predictors that were examined are 
given in Appendix A. 

Step 3 - Determine Predictors 

From the plots created in step 3, the following generalizations and decisions were made 
in forming the nonlinear model. First, if a predictor with a relationship containing a high 
ordered variable appeared to exist , e.g., coefficient of rolling moment due to beta is related to 
alpha by alpha cubed, then all lower ordered predictors of the same relationship were also 
included for the regression analysis. Second, from observations of the plots, certain ranges of 
the plots exhibited nonlinear behavior. One example of this was in the plots of beta versus 
collective flaps (see Plot 3 of Appendix A), where the coefficient resembled a sum of two 
different plots. To actually attempt to characterize this plot as a polynomial would have 
required too many high order terms. Although modeling with high order terms may produce a 
better fit, it may also over fit the model thereby masking the actual intrinsic behavior of the 
system. One alternative to a polynomial solution is to use a piecewise linear approach. A 
simpler solution, however, is to limit the flight envelope for beta to plus or minus 2.5 degrees, 
which also limits the number of predictor terms needed in the model. Within this region, the 
characteristics are straightforward enough to require using only the first and second-order 
terms without need of a more complicated piecewise linear scheme. Although this may seem 
too restrictive, this limit did not restrict the effectiveness of the nonlinear model, as will be 
shown later in subsection 4.2.3. Similar reasoning led to constraints placed on the rudder 
deflection and the asymmetrical canard deflection. The limits to these three parameters are 
summarized below: 
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1 . 


-2.5 

< beta 

< 

2.5 degrees 

-20.0 

< rudder 

< 

20.0 degrees 

-15.0 

< asymmetrical canard 

< 

15.0 degrees 


Examination of the plots reduced the predictor effects to the rolling moment coefficient 
into following groups: 


Large effect terms: 

pa 3 

Pa 2 

pa 



SFAa 2 

8facc 

Shtacx 2 

SHTAa 


8a 2 

pa 

pa 2 

ra 2 

Small effect terms: 

8vc« 2 

5yc a 




ShtaSfc 2 

ShtaSfc 

(5fa8fc 2 ) 

(SfaSfc) 


PSsp 

P5fc 



Insignificant terms: 

5r8pc 

SvcP 

ShtaSfc 



(•) = not examined 

Guidelines used to delineate the groups were based in part on the asymmetrical flap deflection. 
It was decided that a good threshold for determining a predictor's significance to the rolling 
moment would be the amount of rolling moment caused by one degree of asymmetical flap 
deflection (with a and P both at zero degrees). This level was -2.25 E-3; at the chosen design 
flight condition. Thus if any predictor, over the full range of the independent variable, did not 
display a difference in rolling moment of greater than I -2.25 E-3 I, then that predictor was 
deemed insignificant. Since differentiating between large and small only serves to set the order 
by which the predictor terms are tried in the regression analysis (in case the computer cannot 
handle all the predictors at once) and does not eliminate any predictor terms, the actual cutoff 
level chosen is not that important. An arbitrary level of 1.0 E-2 (approximately 5 times the one 
degree flap effectiveness) was set as the cutoff between large and small predictor terms. 
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In addition to these predictor terms, those terms from [8] that are consistent with the 


quasi-linear model were added, viz. 


p* p3, p4 t 05 p3 0 2 p3« . 


Because the analysis method depends on visual interpretation of the plots, limits to the number 
of cross variables with high orders that can be detected are inherent in the method Also, in the 
case of single, high ordered variable predictors, plots similar to those made for two different 
variables were not possible (e.g., a sensitivity plot of the coefficient of rolling moment due to 0 
as a function of 0 2 ). However, it was possible to rule out the suggested predictors, 04 ^nd 05 
(because none of the Q versus 0 plots indicated any discernible high ordered characteristics). 
After adding the seven lateral axis, linear predictors (i.e., first ordered, single, independent 
variables, y) from the linear model, thirty-one predictor terms were present to be tested in the 
regression analysis. These terms were: 

0, p, r, 8 r , 5 hta, Sfa. 5vc 

0a 3 0a 2 0a 05sp 05 fc ShtaSfc 2 ShtaSfc SfaSfc 2 8fa8fc 

Shtaoc 2 5hta« 8fa« 2 8faoc 8vc« 2 5vc« 5 r a pa 2 pa 

ra 2 ra 0 3 a 2 0 3 a 0 3 0 2 

Step 4 - Perform backward elimination regression analysis 

Before any regression analysis could be implemented, the dependent variables, the non- 
dimensional aerodynamic coefficient of rolling moment, had to be generated. To generate these 
non-dimensional coefficients, an AFT1/F-16 aerodynamic package supplied by NASA was 
used. The software package is based on look-up tables and is comprised of two parts. The 
first part is an initialization routine that reads in all the tables from a data file. The second part 
is a routine that reads in twenty input parameter values (these include independent variables, 
causal variables, and other constants nescessary to drive the program), computes the aircraft 
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non-dimensional coefficients with the help of look-up tables, and outputs eight coefficients. 
The twenty inputs to the latter part of the simulation, REFAERO, are: 


DYNAMIC INPUTS 


Angle of Attack, Arctan (W/U) 

Rad 

Sideslip Angle, Arcsin (V/VTOT) 

Rad 

Mach Number 

N.D. 

Total True Airspeed 

Ft/Sec 

Pressure Altitude 

Ft 

Height of aircraft C.G. above runway 

Ft 

Euler Pitch Angle 

Rad 

Rudder Deflection (+ T.E.L.) 

Deg 

Left Horizontal Tail (+ T.E.D.) 

Deg 

Right Horizontal Tail (+ T.E.D.) 

Deg 

Speed Brakes, (0., 60.), (+ T.E.D.) 

Deg 

Left Trailing Edge Flap (+ T.E.D.) 

Deg 

Right Trailing Edge Flap (+ T.E.D.) 

Deg 

Left Vertical Canard (+ T.E.L.) 

Deg 

Right Vertical Canard (+ T.E.R.) 

Deg 

Sym Leading Edge Flaps (+ L.E.D.) 

Deflection About Hinge Line 

Gear Deflection, 0. = Full Up, 1. = Full Down 

Deg 

X Comp of Rotat Vel 

Rad/Sec 

Y Comp of Rotat Vel 

Rad/Sec 

Z Comp of Rotat Vel 

Rad/Sec 


The standard six degree-of-freedom nondimensional coefficients [10] plus two additional 
coefficients to account for the effects of the angle-of-attack rate on longitudinal forces and 
moments comprise the output: 

OUTPUTS - BODY FRAME 

X Comp of Steady Flow Aero Force 

Y Comp of Steady Flow Aero Force 
Z Comp of Steady Row Aero Force 

X Comp of Steady Flow Aero Moment 

Y Comp of Steady Flow Aero Moment 
Z Comp of Steady Flow Aero Moment 
D( C Lift )/D( CBar*Alphadot/2*Vtot ) 

D( C Pitch )/D( CBar* Alphadot/2* V tot ) 


For this study, which develops the rolling moment only to show the feasibility of an 
expanded envelope residual generator, the requirements for the input and output were less 
numerous. As mentioned earlier in the development of the approach, the quasi-linear model 
(also referred to as the "nonlinear model") approach may eventually depend on using multiple 
models scheduled to the Mach number, therfore, each model must be based on a fixed Mach 
number. As a result, all data generated by the simulation for this modeling effort were based 
on one Mach number. In addition, other parameters that were deemed inconsequential to the 
study or outside the scope of the study were held fixed. In effect, the aircraft was simulated at 
one "flight condition" with no limit to its inertial rates or command deflections. Seven 
parameters were fixed at constant values: 


FIXED VALUES 

Constant Value 


Mach# 

# \ 

V T 

660. 

Altitude 

15000. 

Runway Altitude 

1000. 

Flight Path Angle 

0 . 

Ssb 

0 . 

8GEAR 

0 . 


The remaining thirteen parameters were driven by a random number generator resident 
on the VAX 11-750, varying within the physical limits of the aircraft (deflection limits) or 
within reasonable values encountered during evasive maneuvers (alpha, beta, angular rates). 
Some of the limits were later additionally confined by decisions made in selecting the potential 
terms (see subsection 4.1.2, step 3). The list below gives the original physical limits set on 
the aircraft parameters and their succeeding modifications. 
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SAMPLED VALUES 


where 



min 

max 


a 

-.174533 

.523599 

radians 

p 

-.087267 

.087267 

radians (original) 


-.043633 

.04363 

radians (modified) 

8r 

-30. 

20. 

degrees (original) 


-20. 

20. 

degrees (modified) 

5htl 

-25. 

25. 

degrees 

Shtr 

-25. 

25. 

degrees 

Sfl 

-21.5 

21.5 

degrees 

Sfr 

-21.5 

21.5 

degrees 

SvCL 

-27. 

27. 

degrees (original) 


-15. 

15. 

degrees (modified) 

SvCR 

-27. 

27. 

degrees (original) 


-15. 

15. 

degrees (modified) 

Slef 

-2.43 

29.58 

degrees 

p 

-3.49 

3.49 

radians/sec. 

q 

-.175 

.175 

radians/sec. 

r 

-.436 

.436 

radians/sec. 

Vj 

Total Air Speed 



SsB 

Speed Brake 



Sgear 

Landing Gear 



Sr 

Rudder 



Shtl 

L. Horizontal Tail 



Shtr 

R. Horizontal Tail 



Sfl 

L. Flap 



Sfr 

R. Flap 



Svcl 

L. Canard 



SvCR 

R. Canard 



Slef 

Leading Edge Flap 
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In all, 1000 samples of these thirteen parameters were generated to represent the sample space 
of all possible combinations. More details on the sampling issue will be discussed in 
subsection 4.1.4. 

After the dependent variables had been generated, a regression analysis was used to 
choose the quasi-linear predictor terms of the polynomial. The regression process was a 
backward elimination regression [5] with the following criteria for removing terms from the 
polynomial: 

1 . A significance threshold was computed to represent the minimum level of 
contribution to the non-dimensional rolling moment coefficient that a predictor term should 
have. In general, the greatest control surface influence to the rolling moment is the effects of 
the aileron, or in the case of the AFTI F-16, the flaperons. Thus, for this case, the significance 
threshold was set equal to one degree of asymmetrical flaperon deflection. Therefore, if a 
"typically large" value of a predictor (could be multiple variables, higher order variables, or 
both) multiplied by its coefficient contributes less to the non-dimensional rolling moment 
coefficient than 1 degree of asymmetrical flap deflection, then that predictor term was deemed 
insignificant and dropped from the polynomial. The "typically large" values chosen to 
represent the variables were: 


a 

0.52 

radians 

p 

0.044 

radians 

p 

3.50 

radians/sec 

r 

0.44 

radians/sec 

5r 

20.0 

degrees 

5htl or 8 htr 

25.0 

degrees 

8fl or 8 fr 

21.5 

degrees 

Svcl or 8 vcr 

15.0 

degrees 


The threshold level for significance, that is, the non-dimensional rolling moment coefficient for 
one degree of asymmetrical flap (as determined from the first regression run) was Q = -1.785 
E-3. 
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2. It was decided that the error standard deviation (variance)for the original, nonlinear 
set of predictors (31 terms) should not deteriorate by more than 10% (21%). Computation of 
the sample variance of the predicted error in the residual is given by (see Section 2) 


2 1 
FOM = 


n- 1 


r y + a s T (x s T X s 


I a s ■ 2as 


( x s T y 


+ o y +a s 


'S a S 


(4-7) 


where a s and X s are scaled versions of the vector a and the matrix X, as described in Eq. 2-13 
(scaling is discussed in subsection 4.1.4. 

The above two criteria were applied until either all remaining predictor terms complied 
with the first critierion or until the FOM (the prediction-error variance) of the latest regression 
run had exceeded the ten percent limit 


Linear Model 

The linear case was developed to provide a standard for comparison to the nonlinear 
cases. The sample-variance of the model prediction-error for the linear case was 4.53495 E-5 
(standard deviation of about 6.7342 E-3). 

The resulting linear model was 

C 1 = C lp'P + W^ Cl p’ P + 2V^ C V r 

+ Q§r • 5 r + QShta ' 8 HTA + QgpA * 5 FA + c l5yc * 5 VC 

= (-1.03E-1) p + (-7.36E-3) p + (9.08E-4) r 

+ (2.02E-4) 8 r + (-1.41E-3) SfjTA + (-1.44E-3) SpA + (3.77E-5) 8yc (4_g) 
Nonlinear Model 

The nonlinear regression required many iterations of the backward elimination proce- 
dure until one of the criteria was violated. The final form of the nonlinear equation contains 22 
terms, six of which are linear terms. Table 4-2 shows the evolution of the regression analysis. 
As each term was removed from the polynomial, the loss of accuracy of the FOM was small. 
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TABLE 4.2 


Trial 

Number 

Number 
of Terms 

FOM 2 

Step Taken 

1 

31 

5.5482 E-6 

remove p 2 

2 

30 

5.5489 E-6 

remove P 3 

3 

29 

5.5507 E-6 

remove P 8 fc 

4 

28 

5.5578 E-6 

remove P 3 a 2 

5 

27 

5.5577 E-6 

remove p 3 a 

6 

26 

5.5593 E-6 

remove P 8sp 

7 

25 

5.5737 E-6 

remove r 

8 

24 

5.7051 E-6 

remove 8 hta Sfc 2 

9 

23 

5.7052 E-6 

remove 8yc 

10 

22 

5.8646 E-6 

remove 8 fa Sfc 2 

11 

21 

5.8646 E-6 

add 8vc 

12 

22 

5.7059 E-6 

keep model 


The removal of & VC did produce a larger relative increase of the FOM than any of the other 
terms, including the last one. Thus 8yc was retained even though its maximum effect was 
below the one degree of flap threshold. This choice returned favorable results because the 
FOM with 8yc was actually lower than the FOM without from the previous iteration. 

The full 31-term model is: 


= -9.59E-02 p 

+ -8.15E-03 p 

+ -2.02E-03 r 

+ 5.03E-04 8r 

+ -1.58E— 03 ShTA 

+ -1.77E-03 8fa 

+ 8.84E-05 6yc 

+ -1.004 pa3 

+ 0.775 pa 2 

+ -0.216 Pa 

+ 7.78E-04 P8sp 

+ -3.67E-04 P8fC 

+ 6.46E-03 5pACc 2 

+ -5.59E-04 8fa® 

+ 7.46E-08 SpA^FC 2 

+ 2.67E-05 8fa5fC 

+ 6.15E-03 5htA« 2 

+ -1.43E-03 8hTA“ 

+ -1.23E-08 8HTA8FC 2 

+ 2.51E-06 8HTA8FC 

+ -1.68E-03 8 r a 

+ -6.61E-03 pa 2 

+ 6.66E-03 pa 

+ 1.37E-03 8yca 2 

+ -9.06E-04 8yc a 

+ -1.94E-02ra 2 

+ 2.32E-02 ra 

+ -26.43 p3a 2 

+ 8.678 p 3 a 

+ 4.28 p3 

+ 1.86E-02 p 2 

(4-9) 
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The final 22-term polynomial equation for the nonlinear model is: 


= (-8.97E-2) p 

+ (-8.17E-3) p 

+ (5.05E-4) 8r 

+ (-1.77E-3) 8 fa 

+ (9.03E-5) 5 V c 

+ (-9.35E-1) pa3 

+ (-2.03E-1) Pa 

+ (6.45E-3) S FA a2 

+ (-5.54E-4) 8p A a 

+ (6.11 E-3) S HTA a2 

+ (-1.42E-3) 8jpp A ot 

+ (2.45E-6) SjjT A 8pc 

+ (-6.51E-3) pa2 

+ (6.64E-3) pa 

+ (1.45E-3) 8 V c« 2 

+ (-2.42E-2) ra2 

+ (1.98E-3) ra 



+ (-1.58E-3) 5fjT A 
+ (7.05E-1) pot2 
+ (2.67E-5) 5 f A 8 FC 
+ (-1.68E-3) 5 r a 
+ (-9.39E-4) S vc a 

(4-10) 


The final FOM for the 22-term nonlinear model was 2.39 E-3, which is a 64 percent reduction 
in the standard deviation of the residual model error as compared to the linear model FOM of 
6.73 E-3. This model produces a significant inprovement in the predicted error of the residual 
over the linear model. This model also reflects a relatively small loss in accuracy compared to 
the full 31-term case, which had a FOM of 2.35 E-3. Recall that the FOM is a measure of 
model error, and the goal is to minimize the FOM. 

The 22-term model's standard deviation of 2.39 E-3 is roughly one and one-third times 
the one degree of differential flap level of -1.78 E-3 (based on the final model), a good 
improvement over the factor of four from the linear models’ corresponding ratio of standard 
deviation to significance threshold. 


4.1.3 Incorporating Sensor Noise In The Rolling Moment Model 

As detailed in subsection 2.2.3, the quasi-linear regression incorporates the impact of 
sensor noises. The original intent in the development of the sensor noise-incorporated rolling 
moment model was to reduce the regression analysis to one step, that is, given the original set 
of 31 predictors, the optimal solution can be readily determined from the regression coefficients 
output from the 3 1 predictor ran. Unfortunately, the implementation for the generation of £ (in 
Eq. 2-12) is not a trivial one. Due to time constraints and computational requirements, the 
computation of £ was not used to finalize the models (that is, the £ matrix was set to zero). Its 
impact is now discussed. The £ matrix is defined as: 
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where 


E ij = E(W i Wj) 


(4-11) 


Wj = X^-Xj 

For each individual component of E, the expanded term will be a polynomial. This polynomial 
consists of terms, all of which have at least one variable as part of the term with the exception 
of the noise only term. If we assume that all variables have zero mean, then when the expected 
value is taken, all individual terms of each polynomial will have at least one variable to reduce 
that term to zero, with the exception of the one term with all noise variables. Thus, the sigma 
array would consist of components that contain one term each. These terms are in the form of 

i J 

^a ^b- 

Many of these terms are actually a combination of two or more measurements and thus 
also, two or more noise values, e.g., 

8fC + *\FC = 1/2 * ( 5 FL+ 'HFL + 8 FR+ *lFR) (4-12) 

where, 

FC = collective flaperon 
FL = left flaperon 
FR = right flaperon 

For these terms, which can all be written in the form (a+b)K the expansion of the polynomial 
will result in no terms that are all even-ordered if k is odd. (For this specific set of terms, all 
cross terms will result in n being an odd number.) Since all odd moments of a Gaussian 
distribution have zero mean, those terms that are not all even-ordered can be ignored [7], viz., 
given that a variable X has a normal probability density, 


where 



1 x 3 x 5 . . . (k-1) for k even 
0 for k odd 


(4-13) 
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m = mean = E[X] 
<j2 = var [X] 


Therefore, although there are combination terms like the deflections, they can be treated as any 
other measured variables. As an example of the E derivation, let 

X x = (<xp) 

x“ = ap + ii a p + aTip + Ti a -np 

Til 

X 2 = P 


X 


m 

2 



(4-14) 


Sj 2 - ECn^j-E 


2 2 

n a Tip-P + anp+Ti a np 


In addition to the assumptions made above for sigma, simplifications had to be made to 
the cross terms of the E matrix. These simplifications were made because of the complexity of 
implementing symbolic manipulation, which was required to solve the polyomials of the cross 
terms. Instead, it was decided to just model the cross term effects as insignificant compared to 
the diagonal terms. The resulting E matrix will have the form: 


EOljTlj) 



E 012*12,) 


0 


0 


Ef’lnV 


(4-15) 


The diagonal terms of the E matix are given in Table 4-3. 
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TABLE 4-3. DIAGONAL TERMS OF THE £ MATRIX 


TERM 


(ASSUMES ALL MEANS 
OF VARIABLES = 0) 


EM 2 ) 


1 

p 

% 

i 

2 

p 

V 

<4 

3 

r 


«4 

4 


’V 

®? 

5 

S HTA 

H? 

4l°TR +< 4.1 

6 


1 

^<t)FpjH1 F(_) 

4^®FR + °H.) 

7 

8 CA 


7<®0. + ®Cf} 

8 

Pa 3 

V-' 

15 a 2 o* 
P a 

9 

pa 2 

v « 2 

3oj:a 4 
P o 

10 

pa 

V- 

cv 

p • 

11 

P5cc 

’'p 2^ 1 CI_ +i 'cr) 

^(<4r + o «) 

12 

PSfC 


4®j(®FR + ®r_) 

13 


^FR^FL^o 

7 ( 4r + ®h>®1 

14 

8 FA a 


7<®FR + ®FL>®« 

15 

8 fa4 

1 2 

64‘^ 15a FR -3a FR°FL -3<I FR a FL + 15 ®Fl) 

16 

s fa 5 fc 

^FR'^a) toFR +t W 

lef (s^r" 2a FR°a + 3 ct fr) 

17 

- 2 
5 HTA a 

2^^TR 1 Hl^ 

t<®?r + «?i.K 

18 

8 HTA a 

2^tr“ \ 

4"f°TR + ®Tt)®^ 

19 

5 HTA 5 FC 

1 2 
3< 1 >tr- t >tl) (n^+Rn.) 

"f6^ a TR + °?i? ( 3<j fr + 3t Iff?1fl + 3 <> 

20 

8 hta 8 fc 

•^Rtr-Rtl) (WIr/ 

jKr + ®?lH < 4 + <4> 

21 

5 r a 

V»« 

afa 2 

r a 

22 

pa 2 

V4 

3a 2 . a 4 

P« a 

23 

pa 

v>\ 

<4®" 

pb a 

24 

s ca“ 2 

(lcL - Rcfl?R 0 

3f°CR + ®CL>®l 

25 

8 ca“ 

(ncL-RcflJRa 

( < 4r + ®4)«4 

26 

ra 2 

v4 

3<4®: 

27 

ra 

"*" a 

<4®* 

lt> a 

28 

P 3 a 2 

"ft 

15a®a 4 
P « 

29 

p 5 a 

"ft 

is ®y 

p 

30 

P 5 


15a® 

P 

31 

P 2 

< 



R-6563 
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The sensor values that were used for this study were sensor values from an old 
Boeing 737 model. These are listed below: 


a: 

0.007 

radians 

P: 

0.007 

radians 

p: 

0.00035 

radians 

r. 

0.00035 

radians 

$FL'- 

0.1 

degrees 

8fr: 

0.1 

degrees 

Shtl: 

0.1 

degrees 

Shtr: 

0.1 

degrees 

Svcl: 

0.1 

degrees 

SvCR* 

0.1 

degrees 

8r: 

0.1 

degrees 


Linear and nonlinear models were also generated with the sensor noises incorporated 
into the computations. The linear model with sensor noises incorporated resulted in an FOM 
of 6.7 E-3. The equation for this model is: 

CLB = (-1. 03153E-1)P + (-7.37007E-3) p + (9.09075E4)r + (2.02038E-4) 8f 

+ (-1.41048E-3)8htA + (-1.445 12E-3) 8fA + (3.76989E-5) SyC (4-16) 

The nonlinear model (22 predictor terms) with the addition of sensor noises showed 
comparable relative changes to those of the linear model. The FOM was 2.39 E *3 and the 
polynomial equation for Q was: 

CLB = 

+ 

+ 

+ 

+ 

+ 


-8.97E-02 p 
-1.77E-03 5 fa 
- 0.203 Pa 
6. 1 IE-03 ShTAO^ 
-6.51E-03 pa2 
2.42E-02 ra2 


+ -8.17E-03 p 
+ 9.03E-05 8yc 


+ -1.58E-03 8HTA 
+ 0.704 Pa2 
+ 2.67E-05 Sfa^fc 


+ 5.05E-04 8r 
+ 0.934 pa3 

+ 6.45E-03 8fa« 2 + -5.54E-04 8 FA a 

+ -1.42E-03 8HT A a + 2.45E-06 5 ht A 6fc +1.68E-03 8ra 

+ 6.64E-03 pa + 1.45E-03 8y ca 2 + -9.39E-04 8vc a 

+ 1.92E-02ra 


(4-17) 
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The full nonlinear model with 31 -terms and sensor noise calculations is 
CLB = -9.58E-02 p + -8.15E-03 p + -2.02E-03 r + 5.03E-04 8f 

+ -1.58E-03 8HTA + -1.77E-03 8fa + 8.84E-05 8yc + -1003 pa3 

+ 0.774 pa2 + -0.216 pa + 7.78E-04 p8sp + -3.67E-04 P8 fc 

+ 6.46E-03 8pA a2 + -5.59E-04 8pA« + 7.46E-08 SpA^TC 2 + 2.67E-05 SpA^TC 

+ 6.15E-03 8htA« 2 + -1.43E-03 8hTA« + -1.22E-08 8hta8fC 2 + 2.51E-06 8HTASFC 
+ -1.68E-03 8ra + -6.61E-03pa2 + 6.66E-03pa + 1.37E-03 8yca 2 

+ -9.06E-04 8yca + -1.94E-02 ra2 + 2.32E-02 ra + -26.26 p3a2 

+ 8.771 p3a + 4.21 p 3 + 1.86E-02 p 2 (4-18) 

4.1.4 Computational Issues 

To run the regression analysis on the suspected terms, non-dimensional, aerodynamic 
coefficients first must be generated. This output should be representative of the full range of 
the aircraft control inputs and inertial outputs throughout the flight envelope. With thirteen 
input parameters that are varied, a factorial design (all combinations of all levels of each 
parameter) is not feasible. Therefore, the sample inputs that are generated must be well dis- 
tributed over the sample space. This section addresses the issue of generating truly random 
samples for the aerodynamic package and the associated problems of producing well condi- 
tioned random arrays. 

For each run of the regression analysis, one thousand samples or sets of input were 
generated by an accompanying program to the aerodynamic program. The number of samples 
chosen per run was originally limited to 10,000 samples by the hardware limitations of the 
VAX internal storage size. Ideally, a minimum of a factorial sample is desired, that is, a sam- 
ple large enough to cover every possible combination of variables, given a predetermined, dis- 
crete interval for each variable. However, this was not possible and later, due to run-time 
constraints, the number of samples was reduced to 1000 (which produced very good response 
time). To insure that the sample space over the thirteen variables was representative. 
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uniformity checks were made for both the random number seed and for the actual samples that 
were generated. 

The impetus for testing the random number seed and the random number generator on 
the VAX 1 1-750 was based on suspicions that although each parameter could show uniformity 
along its range, that it was still possible that correlation could still exist between the parameters 
or channels. For example, though random numbers for alpha and beta could be evenly dis- 
tributed individually along their full range, nothing precluded all low values of alpha being 
generated when all low values of beta were being generated, and vice versa for the high values. 
Thus, uniformity along n-factorial space was also desired. One method for checking 
non-correlation of values is detailed in [1 1]. This method uses counters for each "factorial 
space" and computes a chi-square value: 


Let Ui's be random values [0,1] 
Let Ui = (Ui, U 2 , ..., U d ) 

U 2 = (Ud+i, U d+2 , .... U2d) 


d K K 


k 2 «i) - ySX.. 

ii-ij2=> 



J 1 J2 



where 

K = # of subintervals in [0,1] 
d = # of dimensions (variables) 
n = # of samples 

/j i j2-.-jd = Ui's having first component in subinterval j 1 and second 
component in subinterval j2, etc. 


(4-19) 


Using the above test for n=3 channels, various random number seeds (some were ones 
suggested by [1 1], others were arbitrarily picked) were evaluated. The random number seed 
that gave the most favorable result was 8374997 which had chi-square = 4021, where 4095 
was the upper limit for a well-behaved random number generator seed. In general, the smaller 
chi-square is, the better the seed value is. The test was repeated for the same seed at n=5 
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channels and only 10 gradations per channel as opposed to 16 gradations for the previous test. 
The resulting chi-square value, 100,234 , was slightly higher than the suggested upper limit, 
99,999. One explanation for the higher values could be the reduction in the fineness of the 
gradations. 

One interesting note discovered during the random number seed tests was that the 
random numbers are highly correlated if used sequentially along a variable. That is, if the 
sequentially generated numbers are distributed down the first variable before being distributed 
down the second variable, etc., as opposed to distributing the numbers across all variables, one 
number per variable. For the case where the numbers are all generated down one variable 
before another, the chi-square value for a three variable case was 330,722.5, where 4095 was 
the acceptable upper limit In addition to testing the random number generator resident on the 
VAX, a Tausworthe generator was implemented as an alternative (see [11]). Although it 
showed promise with respect to lack of correlation, the speed of the generator (more than five 
times slower) made it prohibitively impractical to use or even evaluate extensively. 

After the random number seed was selected, a second test for uniformity was done on 
the actual input array of random numbers generated. (Due to the hardware constraints of the 
VAX, the chi-square test could not test the chosen seed for the thirteen variable case.) The 
input array was a 1000 x 13 array of random numbers between 0.0 and 1.0 called X seec j. The 
pseudo-inverse of X see d was taken (more specifically, X^^^seed was checked for 
singularity) to see if it was well conditioned. To determine whether the array was well- 
conditioned, singular value decomposition was utilized to examine the condition number. This 
number is a ratio of the largest value to the smallest singular value. The resulting condition 
number from this verification was 42.66, well within working precision limits. 

Although the sampled array (13 input variables with values [0,1] X 1000 points) 
generated by the random number generator was well conditioned, the resulting scaled X*X 
array was not The scaled X l X array contains the random values adjusted to the minimum and 
maximum ranges of each individual variable. Due to the large storage demands of processing 
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such large arrays, the code had to be implemented in single precision. This limited working 

precision caused the X*X to appear singular during the inversion process. Using X*X in the 

solution method when the array is singular further compunds the problem of an ill-scaled. X 

array. While methods do exist for avoiding the pseudo-inverse (such as the LDU method, QR 

method, [12]), it was still preferable to use X*X, if possible, because of the heavy memory 

requirements associated with storing X (X need not be stored to compute X*X). In addition, 

the form X*X is required in the sensor computations described above (see subsection 4.1.3). 

Therefore, the goal was to get X as well conditioned as possible through scaling of the 

columns. This was achieved through the following procedure. 

Let x = [mxn] array , a = coefficient vector [nxl]. Instead of X, use X s = Xd 

and a s = d‘*a where d = diagonal scaling matrix. Then 

y = Xa = (Xd) (d^a) = X s a s 
(X S TX S ) a s = Xjy 

a s = [X S TX S ]-1 X s Ty 

a = d[X s 1X s ]-l X s T y (4-20) 

For the case using X, 

a = d(X s Tx s + X s )-lX s Ty (4-21) 

where 

Is = d T Xd . 

For determining which variables to scale and by how much, the heuristic used was to scale by 
factors of ten so that all the X(X diagonal elements were within an order of magnitude from 
each other. The scaling factors that were chosen are given below: 


1 

P 

.1 

8 

pa 3 

100 

2 

P 

.1 

9 

Pa 2 

100 

3 

r 

.1 

10 

Pa 

100 

4 

Sr 

.01 

11 

PSsp 

1 

5 

Shta 

.01 

12 

PSfc 

1 

6 

Sfa 

.1 

13 

8fa« 2 

1 

7 

Svc 

.1 

14 

5fa« 

0. 
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15 

SfaSfc 2 

0.001 

24 

5vc« 2 

1 

16 

SfaSfc 

0.01 

25 

5yc a 

0.1 

17 

Shtaoc 2 

0.1 

26 

ra 2 

10 

18 

$HTA a 

0.1 

27 

ra 

10 

19 

ShtaSfc 2 

0.0001 

28 

p3« 2 

105 

20 

ShtaSfc 

0.01 

29 

p3 a 

10 5 

21 

5r(x 

0.1 

30 

P 3 

10 4 

22 

pa 2 

1 

31 

P 2 

10 3 

23 

pa 

1 





4.2 RESIDUAL GENERATION -IMPLEMENTATION 

After the coefficients for the quasi-linear models have been produced, the process of 
generating the residuals can be completed. The purpose of this section is to describe the imple- 
mentation of the residual generator. A residual generation program was implemented on the 
VAX 1 1-750 similar to the program that was created for the single flight condition residual 
generation from an earlier task [2]. The model for the aircaraft dynamics and kinematics used 
to create the residuals plus some preliminary calculations incorporated to prepare the flight data 
are given in subsection 4.2.1. The test plan for the simulations is outlined in subsection 4.2.2, 
and the test results and conclusions are presented in subsections 4.2.3 and subsections 4.2.4, 
respectively. 

4.2.1 Residual Generation Equations 

The general force and moment balance equations are given by 

X = QS (CXB) 

Y = QS (CYB) 

Z = QS (CZB) 

L = QSb (CLB) 

M = QSc (CMB) 

N = QSb (CNB) 

From the rolling moment, the CLB is obtained from one of the Ci models in subsection 4.1. 
The predicted angular acceleration along the X-axis can be computed as: 
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p = 


(Iyy-I z 

Vi 1 


/ i xx 


* r* 


q + % 

/ A xx 


(4-22) 


Using the tapezoidal rule, with p computed from the present and previous roll rates, the 
residual is derived as: 

v(k+l) = p(k + l)- P (k ^ + . ^ (4-23) 


The flight data that provides the measured deflections and also the aerodynamic values 
such as a, P, p, q, r, etc. are retrieved from sequential data generated from a simulation 
package that used REFAERO as the aerodynamic model. These simulation runs were 
generated by NASA based on the maneuvers listed in the test plan (subsection 4.2.2). To 
insure that the data had the proper units and format, the data was configured from its original 
form (binary, 97 channels) to a temporary form more readily accessible to the residual 
generator (ascii, 18 channels). Since the flight data was generated from the NASA simulation 
package, it represented the true aircraft states. To simulate the errors inherent in measurement, 
noise was added to the true data before it was passed to the residual generator. 


4.2.2 Test Plan 

The test plan calls for simulation runs using three different aircraft maneuvers. These 
three maneuvers were selected from typical maneuvers encountered during normal flight. It is 
expected that the three maneuvers will task the range of aircraft motions and required controls. 
The three maneuvers are shown in Table 4-4. These three maneuvers were tested over several 
flight conditions. These flight conditions were chosen by NASA as a representative range of 
conditions, with the intention of displaying the deficiencies of the linear model and the 
robustness of the nonlinear model. The flight conditions are: 


Trim Condition 

Altitude ffeetl 

Speed 

Angle of Attack 

FI 

10,000 

600 ft/sec 

2.84 

F2 

2,500 

Mach .2 

18.82 

F3 

30,00 

Mach 1.4 

2.12 
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TABLE 4-4. TEST PLAN 


Plane initially should be straight and level, p, q, r=0, constant velocity 


Ml - Heading Change 

Navigational Maneuver 


M2 - Peek and Dive 

Evasive Maneuver 


M3- GimbingTum 

Navigational Maneuver 


1.0 

P = 

180 

q = 

0 

1.5 

P = 

0 

q = 

10 

6.0 

P = 

-180 

q= 

0 

6.5 

P = 

0 

q= 

0 

8.0 

stop 




1.0 

P = 

0 

q = 

* 20 

3.0 

P = 

0 

q = 

0 

6.0 

P = 

0 

q = 

20 

8.0 

P = 

360 

q= 

0 

8.5 

P = 

0 

q = 

20 

10.0 

P = 

180 

q = 

0 

11.0 

P = 

0 

i = 

20 

12.5 

P = 

0 

q = 

0 

14.0 

stop 




1.0 

p = 

90 

q = 

10 

1.25 

p = 

0 

q = 

0 

6.25 

p = 

-90 

q = 

-10 

6.50 

p = 

0 

q = 

0 

8.0 

stop 





In addition to making comparisons between the linear and nonlinear cases of the model 
with sensor noises included, runs will be made with the nonlinear model that doesn't 
incorporate predicted sensor noises to show the improvements when sensor noises are 
modeled. Table 4-5 summarizes the simulation runs that are planned. 
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TABLE 4-5. PLANNED SIMULATION RUNS 


Trim 

Maneuver 

Maneuver 

Maneuver 

Condition 

Ml 

M2 

M3 


With Noise 

With Noise 

With Noise 

FI 

Without Noise 

Without Noise 

Without Noise 




With Noise 

F2 



Without Noise 


With Noise 

With Noise 

With Noise 

F3 

Without Noise 

Without Noise 

Without Noise 


4.2.3 Results 

As mentioned above, test runs were made using simulated flight data provided by 
NASA based on a full six degree-of-ffeedom nonlinear aerodynamic software package of the 
AFTI/F-16. This data was a best attempt at the prescribed maneuvers listed in the test plan, 
since no flight control system was available to implement exacdy the desired aircraft 
maneuvers. For many of the following test comparisons, noise was added to the simulated 
flight data. 

The results of the residual generation tests can be categorized into several areas and they 
will be examined in the following order: first, the benefits of the nonlinear model over a linear 
model are analyzed; then tradeoffs due to the reduction of terms will be discussed; next, 
comparisons of the effects of sensor noise modeling are made; and finally, performance of the 
models over several flight conditions are examined. 

In general, it can be gathered that the reduced nonlinear model offers improved accu- 
racy over the standard linear model and that the nonlinear model may use a reduced set of terms 
with no significant loss in accuracy. The incorporation of sensor noise computation produces 
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no discernible improvement in performance as long as the sensor noises are relatively small. 
And the nonlinear model performs well as long as operating conditions were fairly close to the 
modeled conditions. 

Linear vs. Nonlinear models 

To examine the benefits of using a nonlinear model as opposed to using a linear model, 
test runs were made with the linear model without sensor noise computations and the 22-term 
nonlinear model without sensor noise computations. Because the purpose of these compar- 
isons were to look at the effects of using nonlinear predictor terms the two sets of runs wgre 
made without injecting Gaussian noise into the simulated flight data. The linear model and 
nonlinear models are the ones described in subsection 4.1.2 and are also labeled as Eqs. 4-8 
and 4-10, respectively. 

The flight condition selected for these runs, labeled as FI from the previous section, 
most closely resembled the flight condition used to design the models. Although they are not 
identical (airspeed = 600 ft/sec., altitude = 10,000 ft vs. airspeed = 660 ft/sec., altitude = 
15,000 ft) the flight conditions are similar enough to produce representative residuals. Figure 
4-1 shows plots of the linear model residual versus the nonlinear model residual at flight 
condition FI for each of the three maneuvers. Ml, M2, and M3. 

Recall that the FOM of the linear model was 6.73 E-3 and the FOM of the nonlinear 
model 2.39 E-3. From these values, dimensionalized FOMs for these two models can be 
computed. The expected standard deviation in the residual can be roughly approximated as 

q S b (FOM) / Ixx = expected standard deviation of the residual, pdot (4-24) 

where, 

q = dynamic pressure (lbs/ft 2 ) 

S = surface area of wing (ft 2 ) 

b = wingspan (ft) 

Ixx = moment of inertia of the x axis (slugs-ft 2 ) 
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Thus, for the modeled F-16 (using q = 300, S = 300, b = 30, I xx = 9875), the dimen- 
sionalized FOMs are 1 .8 radians/sec 2 for the linear model and .64 radians/sec 2 for the non- 
linear model. These values match up well to the Ml maneuver, which is a heading change, and 
the M3 maneuver, which is the climbing turn. The nonlinear model residuals for these two 
maneuvers are roughly .4 of the linear model. This is slightly worse than the expected 
improvement of .36 but it is a reasonable result, given that the flight conditions do not match 
up exactly. For mild maneuvers, the nonlinear model offers a much better prediction of the 
angular acceleration, pdot 

The expected FOMs do not reflect the larger residuals in Figure 4- lb. However, 
remember that maneuver M2, the peek and dive, is a more severe maneuver designed to 
represent evasion level aircraft behavior. A closer inspection of the angle of sideslip for this 
maneuver (Figure 4-2) will reveal that the aircraft is clearly operating outside the P range that 
was used to design the models. P was limited to a narrow operating bandwidth of 2.5 degrees 
during the design process (subsection 4.1.2, step 3) specifically because it displayed very 
discontinuous properties outside that range, and thus was simplified to a low-ordered 
polynomial model. As a result, the severe nonlinear characteristics of p contributes to a larger 
than expected residual for both models in M2. Had time permitted, a piecewise linear approach 
would have relaxed the requirement for such a narrow limit. 
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Figure 4-lc. Linear vs. Nonlinear M3 FL 



Figure 4-2. Beta for M2 Fl. 
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Backward Elimination Procedure Performance 

The backward elimination process was utilized to reduce the number of terms in the 
original 31 -term nonlinear model (Eq. 4-9 from subsection 4.1.2) to a 22-term model 
(Eq. 4-10 from subsection 4.1.2). It was hypothesized that a reasonable number of terms 
could be removed without significantly reducing the accuracy of the model. From the Figure 
Of Merit computations in subsection 4. 1.2, the loss in accuracy in switching from the nonlinear 
31 -term model to the nonlinear 22-term model was slightly greater than one percent of the 
standard deviation (2.39 E-3 to 2.35 E-3). 

Two plots comparing the residuals generated from the nonlinear 31-terms and nonlinear 
22-terms models are given in Figure 4-3. For these plots, the flight condition chosen was the 
same as in the plots above and the input "flight data" was not injected with noise. Since, it was 
shown that the M2, the peek and dive, is not a representative maneuver given the limit to the 
sideslip angle range, that maneuver is omitted in the plots. Figure 4-3a compares the two 
models during the heading change maneuver (Ml) and Figure 4-3b compares the two models 
during the climbing turn maneuver. As expected. Figure 4-3a shows the minimal loss in accu- 
racy from a 3 1 -term nonlinear model to a 22-term nonlinear model. A peculiar result is shown 
in Figure 4-3b for the M3 maneuver, where it appears that the reduced set of terms actually 
improves on the accuracy of the residuals. A plausible explanation for this phenomenon is that 
the 31 -term model may be overfitted to the sampled data. The region in which this oddity 
occurs, between 1.25 seconds and 6.25 seconds, is the period when the aircraft is in a steady 
climb with no control deflection change or attitude change. Therefore, it is possible that a 
lower number of terms may better describe a simple motion. 
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Residual Mean-Square Minimization Performance 


The original intent of incorporating sensor noise computations was to derive the optimal 
nonlinear model using a sensor noise to modeling noise tradeoff. In addition, models that 
include sensor noise computations should perform better in the residual generation process than 
models that don't consider sensor noises, since in real applications, all measurements, by 
definition, must have some intrinsic noise characteristics. 

To test this hypothesis, residuals were generated using a full 31 -term nonlinear model 
without noise computations (Eq. 4-9 from subsection 4.1.2) and a full 31-term nonlinear 
model with noise computations (Eq. 4-18 from subsection 4.1.3). The 31-term models were 
selected instead of the 22-term models because the 31 -term models include ten terms, that were 
deemed less significant contributors to modeling given their respective inherent noise values, 
that the 22-term models do not have. Theoretically, the model with sensor noise computations 
will downweight these terms more significantly than the model without sensor computations. 
However, the actual regression coefficients of the two models (with and without sensor 
computations) are so similar, i.e., less than one percent difference, it is expected that no 
noticeable difference in the performance of the two models will appear. 

For this comparison, maneuver M3, the climbing turn maneuver, was chosen for the 
same flight condition as for the other runs, namely, FI. The resultant residual for the nonlinear 
model with sensor noise computation and the model without sensor noise computation are 
plotted in Figure 4-4a and Figure 4-4b, respectively. As expected, the two plots are almost 
identical. A closer inspection of the noise computation reveals why this should happen. Recall 
that the purpose for using this method is to remove terms with large sensor noise relative to its 
modeling contribution. But if all sensor noises are modeled at the same level (e.g. , all 
deflections have .1 degree standard deviation) , then they will all have equal weight relative to 
each other, effectively reducing the problem to one that uses no sensor noise computations. 

For the case that is modeled here, all £ values for the individual predictor terms are less than 
one and are small compared to the range of the predictor terms. 
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Figure 4-4a. Nonlinear 31 With Sensor Model Noise M3 FI. 
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Figure 4-4b. Nonlinear 31 Without Sensor Model Noise M3 FI. 
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To show that the Es should not have any effect on the residuals, the following test case 
was executed. A simple two-term polynomial, 
y = 4x + 5w 

was put through the same regression program used for the F-16 models. Ten samples were 
generated for (x,w) where (x,w) varied from -10. to 10. The first test case used identical E 
values for x and w, namely, 
a x = <T w = .01 

The resulting coefficients from the regression produced a x = 3.99 and a w = 4.99, almost 
identical to the true values. However, when the Es are very different, such as, 

G x = 60. <j w = .01, 

then the value of this method is truly realized. For this case, the x variable has a very high 
sensor noise compared to its normal range, thus, it is downweighted in the regression . The 
resulting coefficients for this case are a x = 0.301 and a w = 4.318, reflecting the lack of 
reliability in the x measurement The sensors in the F-16 models more resemble the first test 
case than the second. 

Off-Nominal Flight Condition Performance 

Originally, the development of the extended envelope residual generation process called 
for modeling the F-16 with a nonlinear polynomial at multiple flight conditions. The residual 
generator would then be scheduled across the various flight conditions to provide a more 
responsive model. However, time constraints did not permit implementation of the full scope 
of the plan. Using multiple flight conditions necessitates a tighter fit of the flight characteristics 
for each condition than a method that requires one model to fit all conditions (which must be a 
more relaxed fit to encompass more possible flight conditions). Therefore, it is not expected 
that these models, designed for one specific flight condition, would perform well in other flight 
conditions. 
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To test the robustness of the models, the nonlinear 22-term model (Eq. 4-10 from 
subsection 4.1.2) was used at all three flight conditions with the climbing turn maneuver (M3). 
The results of these runs are plotted together in Figure 4-5. The model performed well not 
only for FI, but also F2, the low-speed case. However, the model breaks down when tasked 
to produce residuals for the supersonic case. This is understandable considering that the 
predictor terms were chosen to characterize the subsonic region of flight, not the highly 
nonlinear region of supersonic flight. 
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Figure 4-5. Nonlinear 22 at Three Flight Conditions M3@F1,F2, F3. 

4.2.4 Summary 

In this section, a method for developing an extended envelope residual generator has 
been given. Using backward elimination regression analysis, a non-linear, polynomial model 
of an AFTI/F-16 is created. Significant effort was placed on deducing the optimal set of 
predictor terms. In this regard, alternative methods for solving the predictor term problem 
were also developed, namely, a residual mean-square minimization method that incorporates 
the use of sensor noise computations. The extended envelope residual generator requires 
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multiple models for multiple flight conditions. However, time did not permit the development 
of any additional model. The residual generation results are therefore based on a models 
developed at a single flight condition. 

The nonlinear models performed better than the linear models, as expected. 
Performance .however, was constrained by the lack of a perfect match between the flight 
condition used to design the model and the flight conditions selected for the "flight data". It 
was also predicted that reducing the original set of nonlinear terms from 31 -terms to 22-terms 
would not significantly detract from the accuracy of the residuals that were generated although 
significantly simplifying computations. Models developed using sensor noise computations 
were expected to perform much better than models that did not consider sensor noise 
computations. However, due to the relatively small sensor noise levels, performance gains 
were minimal. Finally, the models that were developed were not expected to perform 
exceptionally well over a wide range of flight conditions since the whole extended envelope 
approach requires that multiple models, each one tightly fitted to its flight condition, be 
developed. 

Many areas in this method show possibilities for even further accuracy in the residual 
generation process. First of all, multiple flight conditions must be modeled to insure a truly 
robust residual generator. Use of the sensor noise computation method should be exploited if 
sensor noises prove to be high for the aircraft. If sensor noises are relatively low, the 
backward elimination method is very reliable. The reduction of the number of terms could be 
carried out even further, given the promising results of almost no lost accuracy for the terms 
that were removed. Other areas of investigation include the use of a piecewise-linear model to 
circumvent the discontinuous characteristics of certain predictors, such as p. 


81 


TR-378 



SECTIONS 

SUMMARY 


This report presented the results of an effort to develop envelope-expansion methods 
for the control element FDI algorithm developed in [2]. As in past efforts, this effort was 
divided into two related tasks, residual generation and decisionmaking design. Separate 
consideration of these aspects of the FDI problem allows accountability for many of the non- 
idealized effects that make the FDI problem most difficult This effort assumed that the 
structure of the FDI algorithm would be predetermined and that adaptation of its parameters as 
a function of the appropriate flight condition values is required. 

For residual generation, the adaptation mechanism we considered is a model scheduling 
mechanism as opposed to a model "learning" mechanism to avoid the problem of false 
adaptation to the failures we wish to detect Effects that need to be considered include both 
large-amplitude maneuvers and changes due to Mach and altitude. The effect of large 
maneuvers at a single flight condition involves nonlinearities and interactions that are normally 
not considered in a linear aerodynamic model (e.g., for control design). Significant changes 
may also occur as a function of Mach and altitude because of the flexibility of the aircraft and 
the effect on load distributions due to flight condition. Qualitative prediction of the large 
maneuver effects is possible through physical arguments involving standard aerodynamic 
concepts. The so-called "static flexibility" effects are less understood and, therefore, require 
explicit scheduling using look-up tables. 

For large maneuver effects, the scheduling is accomplished "implicitly" by construction 
of an analytic nonlinear model. This model is derived as a simplification to a mature aero 
package, although advanced identification techniques could be directly applied to flight test data - 
as well. The development of a useful nonlinear model for the residual generation process 
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should incorporate physical understanding of aerodynamics (to avoid complex and/or overfitted 
models) and must consider the effects of sensor noise in determining the utility of individual 
elements of the model. Physical understanding led to a "panel method" model format. This 
format, however, had several drawbacks and led to the consideration of a quasi-linear model. 
This model assumes the form of a linear aerodynamic model, but with "derivatives" that are 
modeled as a function of other variables. The selection of which variables influence which 
"derivatives" is then justified from a physical standpoint When the quasi-linear model is 
further expanded into a "parameter-linear" format, regression analysis can be used to estimate 
the best set of parameters. We then derived a small modification to standard regression - 
methods that explicidy deal with sensor errors in determining optimal residual generation 
parameters. 

For decisionmaking (DM), we also assumed that the temporal characteristics (i.e., 
spectral shape) of the residuals are constant so that filtering requirements for each hypothesis 
test do not need to be scheduled. Scheduling of DM parameters is potentially required 
whenever changes to the covariance of the filtered residuals occur and whenever changes to the 
failure directions occur. The former requires changes to both thresholds and projection vectors 
while the latter only requires changes to projection vectors. Although failure directions mav 
change whenever the control derivatives change, if these changes effect all derivatives in a 
similar manner, then the failure directions remain constant When all derivatives are not 
affected in a similar manner, scheduling of the projection vectors must occur. However, this is 
only possible if the parameters affecting the failure directions are measurable. Such is not the 
case when a failure direction is affected by its corresponding control element value. Should 
this occur (as it does for the flaperons on the F-16) care must be taken in the design of tests for 
flaperon failures (particularly in using the pitching-moment residual). 

The measurable quantities upon which scheduling must be based include dynamic 
pressure, roll rate, and angle of attack, since their values have a direct impact on the sensor 
noise component of the residuals. However, other effects, such as those that are modulated by 
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maneuver size are more difficult to describe. One way to establish scheduling requirements for 
these effects is to perform an empirical study (using either a high-fidelity simulation or flight- 
tests) and to schedule parameters as a function of the "size" of aircraft "inputs." 

Once the flight-condition parameters are defined, the DM design goal becomes one of 
balancing complexity and performance of the scheduling mechanism. The simplest DM design 
is a fixed-parameter solution and should be used if its performance is adequate. At the other 
extreme is a DM design in which all parameters must be scheduled. In between these extremes 
a partial fixed/variable design allows for some parameters to be fixed and some to vary as a 
function of flight condition. Design and evaluation methods were given for all three DM- 
design concepts. 

In application of residual-generation methods to the AFTI-F-16, the nonlinear models 
performed better than the linear models, as expected. Performance .however, was constrained 
by the lack of a perfect match between the flight condition used to design the model and the 
flight conditions selected for the "flight data". It was also predicted that reducing the original 
set of nonlinear terms from 32-terms to 22-terms would not significantly detract from the 
accuracy of the residuals that were generated although significantly simplifying computations. 
Models developed using sensor noise computations were expected to perform much better than 
models that did not consider sensor noise computations. However, due to the relatively small 
sensor noise levels, performance gains were minimal. Finally, the models that were 
developed were not expected to perform exceptionally well over a wide range of flight 
conditions since the whole extended envelope approach requires that multiple models, each one 
tightly fitted to its flight condition, be developed. 

Many areas in this method show possibilities for even further accuracy in the residual 
generation process. First of all, multiple flight conditions must be modeled to insure a truly 
robust residual generator. Use of the sensor noise computation method should be exploited if 
sensor noises prove to be high for the aircraft. If sensor noises are relatively low, the 
backward elimination method is very reliable. The reduction of the number of terms could be 
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carried out even further, given the promising results of almost no lost accuracy for the terms 
that were removed. Other areas of investigation include the use of a piece wise-linear model to 
circumvent the discontinuous characteristics of certain predictors, such as p. 
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APPENDIX A 


REPRESENTATIVE AERODYNAMIC INTERACTIONS 



Figure A-l. Sensitivity of Ci to P for Various Values of a. 
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Figure A-6. Sensitivity of Ci to 8 fa for Various Values of a. 
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Figure A-7. Sensitivity of Ci to 8hta for Various Values of a. 
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Figure A-12. Sensitivity of Ci to p for Various Values of a. 



Figure A-13. Sensitivity of Ci to r for Various Values of a. 
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APPENDIX B 


SIMPLIFICATION OF THE DECISION MECHANISM 

The decision mechanism developed in [2] required pairwise comparisons of all failure 
modes implied by the set of trigger results. In the worst case, tests that compare all pairs of 
failure hypotheses would need to be performed. For very large numbers of failures, such a 
methodology is computationally infeasible. Reduction of the number of hypothesis tests for 
large problems is, therefore, desirable. However, since the pairwise methodology ensures 
large sensitivity to each failure mode, it is expected that fewer tests will result in decreased 
performance. Nevertheless, the results of [1] suggest that there is substantial room for FDI 
performance degradation without overall degradation of the restructurable control system of 
which the FDI algorithm is a part 

One of the critical features of the FDI algorithm in [2] is the use of a sequential test 
strategy for the individual hypothesis tests that comprise the DM. This strategy allows the 
system to respond at a speed that is proportional to the size of a failure without compromising 
false alarm performance. Thus fixed sample size tests such as those used in the "decision- 
function" approach described in [13] are not of interest. To obtain a "proportional response" 
sequential tests or multiple window tests must be used. In either case, the DM contains 
individual tests that "fire" (i.e., pass or fail) asynchronously. Thus the DM must be able to 
"reason" about test results as they occur or, as in [1] and [2], provide a mapping from the set 
of possible test results to the set of final decisions. 

To establish the framework for a DM that can utilize fewer individual hypothesis tests, 
we need to define a "reasoning" methodology for the DM to use in its interpretation of test 
results. Analysis of the overall DM can then, theoretically, be obtained through analysis of all 
possible combinations of test results and the resulting decisions that can be made (note that in 
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[2] the mapping from test results to decisions was many to one, thereby allowing aggregation 
of many test result combinations in the calculation of overall performance). 

The interpretation of individual test results in terms of overall decisions is a problem in 
distributed decisionmaking. Such problems are very difficult as outlined in [14], although 
many special cases have simple solutions [15]. For the FDI problem, the key information 
about individual tests that must be available to the DM for test interpretation is the conditional 
likelihoods defined by: 

p(Ti fails | Hj,fj) (5-1) 

and 

p(Ti passes I Hj, fj) , (5-2) 

where Hj, fj indicates that failure mode j occurred with a failure "magnitude" fj. From this 
basic information, Bayes rule can be applied as in [15] to obtain the posterior probability 
density function of fj for all j (conditioned on a specific set of test results). If the tests are 
designed properly, then the posterior distributions will indicate that only one failure mode has a 
significant probability of failure when that failure has actually occurred. 

For example, the pairwise tests in [2] can be ideally interpreted by the following: 

1 . Test Tjj failing implies that fj = 0, and for k * j, | fk I > fjk'J > 0 

2. Test Tjj passing implies that fi = 0, and for k * i, |fk | > f^i > 0 

Note that the tests are designed so that fji) is smaller than any other fj w (k, 1 *j) and similarly 
for fib. When a set of tests pass and fail, the distribution of each fk is given by the intersection 
of the real line sets implied by applying 1 and 2. Thus, if failure i occurs, and all tests Tjj (j?=d) 
fail, then the only failure mode with a nonzero "signature-set" is fj. Equations 5-1 and 5-2 are 
simply probabilistic descriptions of the test interpretations described above. 
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Now, with this method of interpreting tests, we can envision a design process that 
creates tests and the information in the form of Eqs. 5-1,2 for each test. Analysis of all 
interpretations of all test results can then be made and from this, the mapping from individual 
test results to final failure decisions can be created. 
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